Nov 03 16:18:35 user nova-compute[74932]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74932) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74932) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74932) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 16:18:35 user nova-compute[74932]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:18:35 user nova-compute[74932]: INFO nova.virt.driver [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 03 16:18:35 user nova-compute[74932]: INFO nova.compute.provider_config [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Acquiring lock "singleton_lock" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Acquired lock "singleton_lock" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Releasing lock "singleton_lock" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Full set of CONF: {{(pid=74932) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ******************************************************************************** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Configuration options gathered from: {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ================================================================================ {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] allow_resize_to_same_host      = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] arq_binding_timeout            = 300 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] backdoor_port                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] backdoor_socket                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] block_device_allocate_retries  = 300 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] block_device_allocate_retries_interval = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cert                           = self.pem {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute_monitors               = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] config_dir                     = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] config_drive_format            = iso9660 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] config_source                  = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] console_host                   = user {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] control_exchange               = nova {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cpu_allocation_ratio           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] daemon                         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] debug                          = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] default_access_ip_network_name = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] default_availability_zone      = nova {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] default_ephemeral_format       = ext4 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] default_green_pool_size        = 1000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] default_schedule_zone          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] disk_allocation_ratio          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] enable_new_services            = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] enabled_apis                   = ['osapi_compute'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] enabled_ssl_apis               = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] flat_injected                  = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] force_config_drive             = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] force_raw_images               = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] graceful_shutdown_timeout      = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] heal_instance_info_cache_interval = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] host                           = user {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_build_timeout         = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_delete_interval       = 300 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_format                = [instance: %(uuid)s]  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_name_template         = instance-%08x {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_usage_audit           = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_usage_audit_period    = month {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] internal_service_availability_zone = internal {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] key                            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] live_migration_retry_count     = 30 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_config_append              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_dir                        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_file                       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_options                    = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_rotate_interval            = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_rotate_interval_type       = days {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] log_rotation_type              = none {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] long_rpc_timeout               = 1800 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] max_concurrent_builds          = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] max_concurrent_live_migrations = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] max_concurrent_snapshots       = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] max_local_block_devices        = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] max_logfile_count              = 30 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] max_logfile_size_mb            = 200 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] maximum_instance_delete_attempts = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metadata_listen                = 0.0.0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metadata_listen_port           = 8775 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metadata_workers               = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] migrate_max_retries            = -1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] mkisofs_cmd                    = genisoimage {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] my_ip                          = 10.0.0.210 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] network_allocate_retries       = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] osapi_compute_listen_port      = 8774 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] osapi_compute_unique_server_name_scope =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] osapi_compute_workers          = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] password_length                = 12 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] periodic_enable                = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] periodic_fuzzy_delay           = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] pointer_model                  = ps2mouse {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] preallocate_images             = none {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] publish_errors                 = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] pybasedir                      = /opt/stack/nova {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ram_allocation_ratio           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rate_limit_burst               = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rate_limit_except_level        = CRITICAL {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rate_limit_interval            = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reboot_timeout                 = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reclaim_instance_interval      = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] record                         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reimage_timeout_per_gb         = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] report_interval                = 120 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rescue_timeout                 = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reserved_host_cpus             = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reserved_host_disk_mb          = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reserved_host_memory_mb        = 512 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] reserved_huge_pages            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] resize_confirm_window          = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] resize_fs_using_block_device   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] resume_guests_state_on_host_boot = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rpc_response_timeout           = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] run_external_periodic_tasks    = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] running_deleted_instance_action = reap {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] running_deleted_instance_poll_interval = 1800 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] running_deleted_instance_timeout = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler_instance_sync_interval = 120 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_down_time              = 720 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] servicegroup_driver            = db {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] shelved_offload_time           = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] shelved_poll_interval          = 3600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] shutdown_timeout               = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] source_is_ipv6                 = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ssl_only                       = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] state_path                     = /opt/stack/data/nova {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] sync_power_state_interval      = 600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] sync_power_state_pool_size     = 1000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] syslog_log_facility            = LOG_USER {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] tempdir                        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] timeout_nbd                    = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] transport_url                  = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] update_resources_interval      = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_cow_images                 = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_eventlog                   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_journal                    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_json                       = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_rootwrap_daemon            = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_stderr                     = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] use_syslog                     = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vcpu_pin_set                   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plugging_is_fatal          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plugging_timeout           = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] virt_mkfs                      = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] volume_usage_poll_interval     = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] watch_log_file                 = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] web                            = /usr/share/spice-html5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_concurrency.disable_process_locking = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:35 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.auth_strategy              = keystone {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.compute_link_prefix        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.dhcp_domain                = novalocal {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.enable_instance_password   = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.glance_link_prefix         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.instance_list_per_project_cells = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.list_records_by_skipping_down_cells = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.local_metadata_per_cell    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.max_limit                  = 1000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.metadata_cache_expiration  = 15 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.neutron_default_tenant_id  = default {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.use_forwarded_for          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.use_neutron_default_nets   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_dynamic_targets = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_jsonfile_path   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.backend                  = dogpile.cache.memcached {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.backend_argument         = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.config_prefix            = cache.oslo {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.dead_timeout             = 60.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.debug_cache_backend      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.enable_retry_client      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.enable_socket_keepalive  = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.enabled                  = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.expiration_time          = 600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.hashclient_retry_attempts = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_dead_retry      = 300 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_password        =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_pool_maxsize    = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_sasl_enabled    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.memcache_username        =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.proxies                  = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.retry_attempts           = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.retry_delay              = 0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.socket_keepalive_count   = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.socket_keepalive_idle    = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.socket_keepalive_interval = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.tls_allowed_ciphers      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.tls_cafile               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.tls_certfile             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.tls_enabled              = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cache.tls_keyfile              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.auth_section            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.auth_type               = password {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.cafile                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.certfile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.collect_timing          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.cross_az_attach         = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.debug                   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.endpoint_template       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.http_retries            = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.insecure                = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.keyfile                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.os_region_name          = RegionOne {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.split_loggers           = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cinder.timeout                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.cpu_dedicated_set      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.cpu_shared_set         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.image_type_exclude_list = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.max_concurrent_disk_ops = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.max_disk_devices_to_attach = -1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.resource_provider_association_refresh = 300 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.shutdown_retry_interval = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] conductor.workers              = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] console.allowed_origins        = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] console.ssl_ciphers            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] console.ssl_minimum_version    = default {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] consoleauth.token_ttl          = 600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.cafile                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.certfile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.collect_timing          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.connect_retries         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.connect_retry_delay     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.endpoint_override       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.insecure                = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.keyfile                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.max_version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.min_version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.region_name             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.service_name            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.service_type            = accelerator {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.split_loggers           = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.status_code_retries     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.timeout                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] cyborg.version                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.backend               = sqlalchemy {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.connection            = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.connection_debug      = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.connection_parameters =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.connection_recycle_time = 3600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.connection_trace      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.db_inc_retry_interval = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.db_max_retries        = 20 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.db_max_retry_interval = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.db_retry_interval     = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.max_overflow          = 50 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.max_pool_size         = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.max_retries           = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.mysql_wsrep_sync_wait = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.pool_timeout          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.retry_interval        = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.slave_connection      = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] database.sqlite_synchronous    = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.backend           = sqlalchemy {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.connection        = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.connection_debug  = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.connection_parameters =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.connection_recycle_time = 3600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.connection_trace  = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.db_inc_retry_interval = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.db_max_retries    = 20 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.db_max_retry_interval = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.db_retry_interval = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.max_overflow      = 50 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.max_pool_size     = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.max_retries       = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.pool_timeout      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.retry_interval    = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.slave_connection  = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] api_database.sqlite_synchronous = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] devices.enabled_mdev_types     = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ephemeral_storage_encryption.enabled = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.api_servers             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.cafile                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.certfile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.collect_timing          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.connect_retries         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.connect_retry_delay     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.debug                   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.default_trusted_certificate_ids = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.enable_certificate_validation = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.enable_rbd_download     = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.endpoint_override       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.insecure                = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.keyfile                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.max_version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.min_version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.num_retries             = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.rbd_ceph_conf           =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.rbd_connect_timeout     = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.rbd_pool                =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.rbd_user                =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.region_name             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.service_name            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.service_type            = image {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.split_loggers           = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.status_code_retries     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.timeout                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.verify_glance_signatures = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] glance.version                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] guestfs.debug                  = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.config_drive_cdrom      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.config_drive_inject_password = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.enable_instance_metrics_collection = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.enable_remotefx         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.instances_path_share    =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.iscsi_initiator_list    = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.limit_cpu_features      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.power_state_check_timeframe = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.use_multipath_io        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.volume_attach_retry_count = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.vswitch_name            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] mks.enabled                    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] image_cache.manager_interval   = 2400 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] image_cache.precache_concurrency = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] image_cache.remove_unused_base_images = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] image_cache.subdirectory_name  = _base {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.api_max_retries         = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.api_retry_interval      = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.auth_section            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.auth_type               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.cafile                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.certfile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.collect_timing          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.conductor_group         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.connect_retries         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.connect_retry_delay     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.endpoint_override       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.insecure                = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.keyfile                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.max_version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.min_version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.peer_list               = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.region_name             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.serial_console_state_timeout = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.service_name            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.service_type            = baremetal {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.split_loggers           = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.status_code_retries     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.timeout                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ironic.version                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] key_manager.fixed_key          = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.barbican_api_version  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.barbican_endpoint     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.barbican_endpoint_type = public {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.barbican_region_name  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.cafile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.certfile              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.collect_timing        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.insecure              = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.keyfile               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.number_of_retries     = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.retry_delay           = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.send_service_user_token = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.split_loggers         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.timeout               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.verify_ssl            = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican.verify_ssl_path       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.auth_section = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.auth_type = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.cafile   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.certfile = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.collect_timing = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.insecure = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.keyfile  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.split_loggers = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] barbican_service_user.timeout  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.approle_role_id          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.approle_secret_id        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.cafile                   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.certfile                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.collect_timing           = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.insecure                 = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.keyfile                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.kv_mountpoint            = secret {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.kv_path                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.kv_version               = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.namespace                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.root_token_id            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.split_loggers            = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.ssl_ca_crt_file          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.timeout                  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.use_ssl                  = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.auth_section          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.auth_type             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.cafile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.certfile              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.collect_timing        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.connect_retries       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.connect_retry_delay   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.endpoint_override     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.insecure              = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.keyfile               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.max_version           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.min_version           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.region_name           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.service_name          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.service_type          = identity {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.split_loggers         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.status_code_retries   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.timeout               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] keystone.version               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.connection_uri         =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_mode               = custom {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: WARNING oslo_config.cfg [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_power_governor_high = performance {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_power_governor_low = powersave {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_power_management   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.device_detach_attempts = 8 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.device_detach_timeout  = 20 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.disk_cachemodes        = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.disk_prefix            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.enabled_perf_events    = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.file_backed_memory     = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.gid_maps               = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.hw_disk_discard        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.hw_machine_type        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_rbd_glance_store_name =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_rbd_pool        = rbd {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_type            = default {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.images_volume_group    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.inject_key             = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.inject_partition       = -2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.inject_password        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.iscsi_iface            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.iser_use_multipath     = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_bandwidth = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_downtime = 500 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_inbound_addr = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_permit_post_copy = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_scheme  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_timeout_action = abort {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_tunnelled = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: WARNING oslo_config.cfg [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 03 16:18:36 user nova-compute[74932]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 03 16:18:36 user nova-compute[74932]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 03 16:18:36 user nova-compute[74932]: and ``live_migration_inbound_addr`` respectively.
Nov 03 16:18:36 user nova-compute[74932]: ).  Its value may be silently ignored in the future.
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.live_migration_with_native_tls = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.max_queues             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.nfs_mount_options      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.num_memory_encrypted_guests = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.num_pcie_ports         = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.pmem_namespaces        = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.quobyte_client_cfg     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rbd_secret_uuid        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rbd_user               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.remote_filesystem_transport = ssh {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rescue_image_id        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rescue_kernel_id       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rescue_ramdisk_id      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.rx_queue_size          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.smbfs_mount_options    =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.snapshot_compression   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.snapshot_image_format  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.sparse_logical_volumes = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.swtpm_enabled          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.swtpm_group            = tss {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.swtpm_user             = tss {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.sysinfo_serial         = unique {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.tb_cache_size          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.tx_queue_size          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.uid_maps               = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.use_virtio_for_bridges = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.virt_type              = kvm {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.volume_clear           = zero {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.volume_clear_size      = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.volume_use_multipath   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_cache_path   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.vzstorage_mount_user   = stack {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.auth_section           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.auth_type              = password {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.cafile                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.certfile               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.collect_timing         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.connect_retries        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.connect_retry_delay    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.default_floating_pool  = public {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.endpoint_override      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.extension_sync_interval = 600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.http_retries           = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.insecure               = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.keyfile                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.max_version            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.min_version            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.ovs_bridge             = br-int {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.physnets               = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.region_name            = RegionOne {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.service_metadata_proxy = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.service_name           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.service_type           = network {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.split_loggers          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.status_code_retries    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.timeout                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] neutron.version                = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] notifications.bdms_in_notifications = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] notifications.default_level    = INFO {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] notifications.notification_format = unversioned {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] notifications.notify_on_state_change = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] pci.alias                      = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] pci.device_spec                = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] pci.report_in_placement        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.auth_section         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.auth_type            = password {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.cafile               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.certfile             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.collect_timing       = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.connect_retries      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.connect_retry_delay  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.default_domain_id    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.default_domain_name  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.domain_id            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.domain_name          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.endpoint_override    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.insecure             = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.keyfile              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.max_version          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.min_version          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.password             = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.project_domain_id    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.project_domain_name  = Default {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.project_id           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.project_name         = service {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.region_name          = RegionOne {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.service_name         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.service_type         = placement {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.split_loggers        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.status_code_retries  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.system_scope         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.timeout              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.trust_id             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.user_domain_id       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.user_domain_name     = Default {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.user_id              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.username             = placement {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] placement.version              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.cores                    = 20 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.count_usage_from_placement = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.injected_file_content_bytes = 10240 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.injected_file_path_length = 255 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.injected_files           = 5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.instances                = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.key_pairs                = 100 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.metadata_items           = 128 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.ram                      = 51200 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.recheck_quota            = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.server_group_members     = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] quota.server_groups            = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rdp.enabled                    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.image_metadata_prefilter = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.max_attempts         = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.max_placement_results = 1000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.query_placement_for_image_type_support = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] scheduler.workers              = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.host_subset_size = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.isolated_hosts = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.isolated_images = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.pci_in_placement = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.track_instance_changes = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metrics.required               = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metrics.weight_multiplier      = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] metrics.weight_setting         = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] serial_console.enabled         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] serial_console.port_range      = 10000:20000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] serial_console.serialproxy_port = 6083 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.auth_section      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.auth_type         = password {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.cafile            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.certfile          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.collect_timing    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.insecure          = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.keyfile           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.send_service_user_token = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.split_loggers     = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] service_user.timeout           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.agent_enabled            = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.enabled                  = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.html5proxy_port          = 6082 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.image_compression        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.jpeg_compression         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.playback_compression     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.server_listen            = 127.0.0.1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.streaming_mode           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] spice.zlib_compression         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] upgrade_levels.baseapi         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] upgrade_levels.cert            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] upgrade_levels.compute         = auto {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] upgrade_levels.conductor       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] upgrade_levels.scheduler       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.auth_section = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.auth_type = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.cafile = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.certfile = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.insecure = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.keyfile = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vendordata_dynamic_auth.timeout = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.api_retry_count         = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.ca_file                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.cache_prefix            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.cluster_name            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.connection_pool_size    = 10 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.console_delay_seconds   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.datastore_regex         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.host_ip                 = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.host_password           = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.host_port               = 443 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.host_username           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.insecure                = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.integration_bridge      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.maximum_objects         = 100 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.pbm_default_policy      = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.pbm_enabled             = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.pbm_wsdl_location       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.serial_port_proxy_uri   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.serial_port_service_uri = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.task_poll_interval      = 0.5 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.use_linked_clone        = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.vnc_keymap              = en-us {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.vnc_port                = 5900 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vmware.vnc_port_total          = 10000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.auth_schemes               = ['none'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.enabled                    = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.novncproxy_port            = 6080 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.server_listen              = 0.0.0.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.vencrypt_ca_certs          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.vencrypt_client_cert       = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vnc.vencrypt_client_key        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.disable_rootwrap   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.enable_numa_live_migration = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.libvirt_disable_apic = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.client_socket_timeout     = 900 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.default_pool_size         = 1000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.keep_alive                = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.max_header_line           = 16384 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.ssl_ca_file               = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.ssl_cert_file             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.ssl_key_file              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.tcp_keepidle              = 600 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] zvm.ca_file                    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] zvm.cloud_connector_url        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] zvm.reachable_timeout          = 300 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.enforce_new_defaults = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.enforce_scope      = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.policy_default_rule = default {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.policy_file        = policy.yaml {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.connection_string     = messaging:// {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.enabled               = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.es_doc_type           = notification {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.es_scroll_size        = 10000 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.es_scroll_time        = 2m {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.filter_error_trace    = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.hmac_keys             = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.sentinel_service_name = mymaster {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.socket_timeout        = 0.1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.trace_requests        = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler.trace_sqlalchemy      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler_jaeger.process_tags   = {} {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler_jaeger.service_name_prefix = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] profiler_otlp.service_name_prefix = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] remote_debug.host              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] remote_debug.port              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.ssl      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_notifications.retry = -1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.auth_section        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.auth_type           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.cafile              = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.certfile            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.collect_timing      = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.connect_retries     = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.connect_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.endpoint_id         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.endpoint_override   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.insecure            = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.keyfile             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.max_version         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.min_version         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.region_name         = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.service_name        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.service_type        = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.split_loggers       = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.status_code_retries = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.status_code_retry_delay = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.timeout             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.valid_interfaces    = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_limit.version             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_reports.file_event_handler = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] oslo_reports.log_dir           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_ovs_privileged.group  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] vif_plug_ovs_privileged.user   = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.flat_interface = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.isolate_vif         = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_vif_ovs.per_port_bridge     = False {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] os_brick.lock_path             = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] privsep_osbrick.capabilities   = [21] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] privsep_osbrick.group          = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] privsep_osbrick.helper_command = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] privsep_osbrick.user           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] nova_sys_admin.group           = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] nova_sys_admin.helper_command  = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] nova_sys_admin.user            = None {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG oslo_service.service [None req-931daa0c-dead-4e09-95c4-a0b509c29d7a None None] ******************************************************************************** {{(pid=74932) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 03 16:18:36 user nova-compute[74932]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Connecting to libvirt: qemu:///system {{(pid=74932) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdc8cacef50> {{(pid=74932) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 03 16:18:36 user nova-compute[74932]: libvirt:  error : internal error: could not initialize domain event timer
Nov 03 16:18:36 user nova-compute[74932]: WARNING nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdc8cacef50> {{(pid=74932) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Starting native event thread {{(pid=74932) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Starting green dispatch thread {{(pid=74932) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Starting connection event dispatch thread {{(pid=74932) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 03 16:18:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Connection event '1' reason 'None'
Nov 03 16:18:36 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 16:18:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.mount [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Initialising _HostMountState generation 0 {{(pid=74932) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 03 16:18:43 user nova-compute[74932]: INFO nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host capabilities <capabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <host>
Nov 03 16:18:43 user nova-compute[74932]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 03 16:18:43 user nova-compute[74932]:     <cpu>
Nov 03 16:18:43 user nova-compute[74932]:       <arch>x86_64</arch>
Nov 03 16:18:43 user nova-compute[74932]:       <model>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <microcode version='1070'/>
Nov 03 16:18:43 user nova-compute[74932]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='osxsave'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='invtsc'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='rsba'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature name='skip-l1dfl-vmentry'/>
Nov 03 16:18:43 user nova-compute[74932]:       <pages unit='KiB' size='4'/>
Nov 03 16:18:43 user nova-compute[74932]:       <pages unit='KiB' size='2048'/>
Nov 03 16:18:43 user nova-compute[74932]:     </cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <power_management>
Nov 03 16:18:43 user nova-compute[74932]:       <suspend_mem/>
Nov 03 16:18:43 user nova-compute[74932]:       <suspend_disk/>
Nov 03 16:18:43 user nova-compute[74932]:       <suspend_hybrid/>
Nov 03 16:18:43 user nova-compute[74932]:     </power_management>
Nov 03 16:18:43 user nova-compute[74932]:     <iommu support='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <migration_features>
Nov 03 16:18:43 user nova-compute[74932]:       <live/>
Nov 03 16:18:43 user nova-compute[74932]:       <uri_transports>
Nov 03 16:18:43 user nova-compute[74932]:         <uri_transport>tcp</uri_transport>
Nov 03 16:18:43 user nova-compute[74932]:         <uri_transport>rdma</uri_transport>
Nov 03 16:18:43 user nova-compute[74932]:       </uri_transports>
Nov 03 16:18:43 user nova-compute[74932]:     </migration_features>
Nov 03 16:18:43 user nova-compute[74932]:     <topology>
Nov 03 16:18:43 user nova-compute[74932]:       <cells num='2'>
Nov 03 16:18:43 user nova-compute[74932]:         <cell id='0'>
Nov 03 16:18:43 user nova-compute[74932]:           <memory unit='KiB'>8189224</memory>
Nov 03 16:18:43 user nova-compute[74932]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 03 16:18:43 user nova-compute[74932]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 16:18:43 user nova-compute[74932]:           <distances>
Nov 03 16:18:43 user nova-compute[74932]:             <sibling id='0' value='10'/>
Nov 03 16:18:43 user nova-compute[74932]:             <sibling id='1' value='20'/>
Nov 03 16:18:43 user nova-compute[74932]:           </distances>
Nov 03 16:18:43 user nova-compute[74932]:           <cpus num='6'>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 03 16:18:43 user nova-compute[74932]:           </cpus>
Nov 03 16:18:43 user nova-compute[74932]:         </cell>
Nov 03 16:18:43 user nova-compute[74932]:         <cell id='1'>
Nov 03 16:18:43 user nova-compute[74932]:           <memory unit='KiB'>8206460</memory>
Nov 03 16:18:43 user nova-compute[74932]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 03 16:18:43 user nova-compute[74932]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 16:18:43 user nova-compute[74932]:           <distances>
Nov 03 16:18:43 user nova-compute[74932]:             <sibling id='0' value='20'/>
Nov 03 16:18:43 user nova-compute[74932]:             <sibling id='1' value='10'/>
Nov 03 16:18:43 user nova-compute[74932]:           </distances>
Nov 03 16:18:43 user nova-compute[74932]:           <cpus num='6'>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 03 16:18:43 user nova-compute[74932]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 03 16:18:43 user nova-compute[74932]:           </cpus>
Nov 03 16:18:43 user nova-compute[74932]:         </cell>
Nov 03 16:18:43 user nova-compute[74932]:       </cells>
Nov 03 16:18:43 user nova-compute[74932]:     </topology>
Nov 03 16:18:43 user nova-compute[74932]:     <cache>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 03 16:18:43 user nova-compute[74932]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 03 16:18:43 user nova-compute[74932]:     </cache>
Nov 03 16:18:43 user nova-compute[74932]:     <secmodel>
Nov 03 16:18:43 user nova-compute[74932]:       <model>apparmor</model>
Nov 03 16:18:43 user nova-compute[74932]:       <doi>0</doi>
Nov 03 16:18:43 user nova-compute[74932]:     </secmodel>
Nov 03 16:18:43 user nova-compute[74932]:     <secmodel>
Nov 03 16:18:43 user nova-compute[74932]:       <model>dac</model>
Nov 03 16:18:43 user nova-compute[74932]:       <doi>0</doi>
Nov 03 16:18:43 user nova-compute[74932]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 03 16:18:43 user nova-compute[74932]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 03 16:18:43 user nova-compute[74932]:     </secmodel>
Nov 03 16:18:43 user nova-compute[74932]:   </host>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='alpha'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>clipper</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='armv6l'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>spitz</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>nuri</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>kzm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sx1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>z2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>tosa</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>n810</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>n800</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>terrier</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>midway</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>microbit</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>verdex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>highbank</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>akita</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>connex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>collie</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='armv7l'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>spitz</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>nuri</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>kzm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sx1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>z2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>tosa</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>n810</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>n800</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>terrier</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>midway</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>microbit</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>verdex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>highbank</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>akita</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>connex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>collie</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='aarch64'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>spitz</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>nuri</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>kzm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sx1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>z2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>tosa</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>n810</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>n800</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>terrier</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>midway</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>microbit</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>verdex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>raspi3b</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>highbank</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>akita</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>connex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>collie</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <acpi default='on' toggle='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='cris'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='i686'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>isapc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>microvm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='kvm'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <pae/>
Nov 03 16:18:43 user nova-compute[74932]:       <nonpae/>
Nov 03 16:18:43 user nova-compute[74932]:       <acpi default='on' toggle='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:       <apic default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='m68k'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>an5206</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>q800</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>next-cube</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='microblaze'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='microblazeel'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='mips'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='16'>malta</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='mipsel'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='16'>malta</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='mips64'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='16'>malta</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>pica61</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>magnum</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='mips64el'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='16'>malta</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>pica61</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>magnum</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='16'>boston</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='ppc'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mac99</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>40p</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>taihu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='ppc64'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>taihu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>40p</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mac99</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='ppc64le'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>taihu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>40p</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>mac99</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='riscv32'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='8'>spike</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>opentitan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='8'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='riscv64'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='8'>spike</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>shakti_c</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='8'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='s390x'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='sh4'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>shix</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>r2d</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='sh4eb'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>shix</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>r2d</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='sparc'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>SS-5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>SS-20</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>LX</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>SS-4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>SS-10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>Voyager</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='sparc64'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sun4u</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>niagara</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>sun4v</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='x86_64'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>64</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='1'>isapc</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>microvm</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='kvm'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <acpi default='on' toggle='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:       <apic default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='xtensa'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>sim</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>kc705</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ml605</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx200</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx60</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]:   <guest>
Nov 03 16:18:43 user nova-compute[74932]:     <os_type>hvm</os_type>
Nov 03 16:18:43 user nova-compute[74932]:     <arch name='xtensaeb'>
Nov 03 16:18:43 user nova-compute[74932]:       <wordsize>32</wordsize>
Nov 03 16:18:43 user nova-compute[74932]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='4'>sim</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>kc705</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ml605</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>virt</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx200</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>lx60</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 16:18:43 user nova-compute[74932]:       <domain type='qemu'/>
Nov 03 16:18:43 user nova-compute[74932]:     </arch>
Nov 03 16:18:43 user nova-compute[74932]:     <features>
Nov 03 16:18:43 user nova-compute[74932]:       <cpuselection/>
Nov 03 16:18:43 user nova-compute[74932]:       <deviceboot/>
Nov 03 16:18:43 user nova-compute[74932]:       <disksnapshot default='on' toggle='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     </features>
Nov 03 16:18:43 user nova-compute[74932]:   </guest>
Nov 03 16:18:43 user nova-compute[74932]: </capabilities>
Nov 03 16:18:43 user nova-compute[74932]: 
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-q35-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>i686</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='288'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'/>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='lm'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-i440fx-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>i686</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='255'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'/>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='lm'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ide</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-q35-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>i686</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='288'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'/>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='lm'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-i440fx-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>i686</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='255'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'/>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='lm'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ide</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-q35-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>x86_64</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='288'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>efi</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='invtsc'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='rsba'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-i440fx-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>x86_64</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='255'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>efi</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='invtsc'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='rsba'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ide</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-q35-jammy</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>x86_64</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='288'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>efi</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='invtsc'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='rsba'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 03 16:18:43 user nova-compute[74932]: <domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 16:18:43 user nova-compute[74932]:   <domain>kvm</domain>
Nov 03 16:18:43 user nova-compute[74932]:   <machine>pc-i440fx-6.2</machine>
Nov 03 16:18:43 user nova-compute[74932]:   <arch>x86_64</arch>
Nov 03 16:18:43 user nova-compute[74932]:   <vcpu max='255'/>
Nov 03 16:18:43 user nova-compute[74932]:   <iothreads supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:   <os supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='firmware'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>efi</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:     <loader supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>rom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pflash</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='readonly'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>yes</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='secure'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>no</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </loader>
Nov 03 16:18:43 user nova-compute[74932]:   </os>
Nov 03 16:18:43 user nova-compute[74932]:   <cpu>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-passthrough' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='hostPassthroughMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='maximum' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='maximumMigratable'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>on</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>off</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='host-model' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <vendor>Intel</vendor>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ss'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='vmx'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pcid'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='hypervisor'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arat'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='umip'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='md-clear'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='invtsc'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibpb'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='ibrs'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-stibp'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='rsba'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='erms'/>
Nov 03 16:18:43 user nova-compute[74932]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:     <mode name='custom' supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>qemu64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>qemu32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>phenom</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>pentium</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>n270</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm64</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>kvm32</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>coreduo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>core2duo</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>athlon</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Westmere</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Snowridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Skylake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>SandyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Penryn</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G5</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G4</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G3</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Opteron_G2</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Opteron_G1</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>IvyBridge</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Icelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Haswell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Rome</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-Milan</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>EPYC</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Dhyana</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cooperlake</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>Conroe</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='no'>Broadwell</model>
Nov 03 16:18:43 user nova-compute[74932]:       <model usable='yes'>486</model>
Nov 03 16:18:43 user nova-compute[74932]:     </mode>
Nov 03 16:18:43 user nova-compute[74932]:   </cpu>
Nov 03 16:18:43 user nova-compute[74932]:   <memoryBacking supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:     <enum name='sourceType'>
Nov 03 16:18:43 user nova-compute[74932]:       <value>file</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>anonymous</value>
Nov 03 16:18:43 user nova-compute[74932]:       <value>memfd</value>
Nov 03 16:18:43 user nova-compute[74932]:     </enum>
Nov 03 16:18:43 user nova-compute[74932]:   </memoryBacking>
Nov 03 16:18:43 user nova-compute[74932]:   <devices>
Nov 03 16:18:43 user nova-compute[74932]:     <disk supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='diskDevice'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>disk</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cdrom</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>floppy</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>lun</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='bus'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ide</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>fdc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sata</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </disk>
Nov 03 16:18:43 user nova-compute[74932]:     <graphics supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='type'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>sdl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vnc</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>spice</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egl-headless</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </graphics>
Nov 03 16:18:43 user nova-compute[74932]:     <video supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='modelType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>cirrus</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>vmvga</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>qxl</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>none</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>bochs</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>ramfb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </video>
Nov 03 16:18:43 user nova-compute[74932]:     <hostdev supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='mode'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>subsystem</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='startupPolicy'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>default</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>mandatory</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>requisite</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>optional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='subsysType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>usb</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>pci</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>scsi</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='capsType'/>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='pciBackend'/>
Nov 03 16:18:43 user nova-compute[74932]:     </hostdev>
Nov 03 16:18:43 user nova-compute[74932]:     <rng supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtio-non-transitional</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>random</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>egd</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>builtin</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </rng>
Nov 03 16:18:43 user nova-compute[74932]:     <filesystem supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='driverType'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>path</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>handle</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>virtiofs</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </filesystem>
Nov 03 16:18:43 user nova-compute[74932]:     <tpm supported='yes'>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='model'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-tis</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>tpm-crb</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:       <enum name='backendModel'>
Nov 03 16:18:43 user nova-compute[74932]:         <value>passthrough</value>
Nov 03 16:18:43 user nova-compute[74932]:         <value>emulator</value>
Nov 03 16:18:43 user nova-compute[74932]:       </enum>
Nov 03 16:18:43 user nova-compute[74932]:     </tpm>
Nov 03 16:18:43 user nova-compute[74932]:   </devices>
Nov 03 16:18:43 user nova-compute[74932]:   <features>
Nov 03 16:18:43 user nova-compute[74932]:     <gic supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:     <vmcoreinfo supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <genid supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backingStoreInput supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <backup supported='yes'/>
Nov 03 16:18:43 user nova-compute[74932]:     <sev supported='no'/>
Nov 03 16:18:43 user nova-compute[74932]:   </features>
Nov 03 16:18:43 user nova-compute[74932]: </domainCapabilities>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74932) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74932) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Checking secure boot support for host arch (x86_64) {{(pid=74932) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 03 16:18:43 user nova-compute[74932]: INFO nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Secure Boot support detected
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] cpu compare xml: <cpu match="exact">
Nov 03 16:18:43 user nova-compute[74932]:   <model>Nehalem</model>
Nov 03 16:18:43 user nova-compute[74932]: </cpu>
Nov 03 16:18:43 user nova-compute[74932]:  {{(pid=74932) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 03 16:18:43 user nova-compute[74932]: INFO nova.virt.node [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Generated node identity 22f2cc45-aa29-4bc9-9ee7-6d401d382067
Nov 03 16:18:43 user nova-compute[74932]: INFO nova.virt.node [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Wrote node identity 22f2cc45-aa29-4bc9-9ee7-6d401d382067 to /opt/stack/data/nova/compute_id
Nov 03 16:18:43 user nova-compute[74932]: WARNING nova.compute.manager [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Compute nodes ['22f2cc45-aa29-4bc9-9ee7-6d401d382067'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 03 16:18:43 user nova-compute[74932]: INFO nova.compute.manager [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 03 16:18:43 user nova-compute[74932]: WARNING nova.compute.manager [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 16:18:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:18:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:18:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Hypervisor/Node resource view: name=user free_ram=10930MB free_disk=26.132659912109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:18:43 user nova-compute[74932]: WARNING nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] No compute node record for user:22f2cc45-aa29-4bc9-9ee7-6d401d382067: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 22f2cc45-aa29-4bc9-9ee7-6d401d382067 could not be found.
Nov 03 16:18:43 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Compute node record created for user:user with uuid: 22f2cc45-aa29-4bc9-9ee7-6d401d382067
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:18:43 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:18:44 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] [req-fe3e608e-dbde-4b2e-b4d5-0bdc85b4171b] Created resource provider record via placement API for resource provider with UUID 22f2cc45-aa29-4bc9-9ee7-6d401d382067 and name user.
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74932) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 03 16:18:44 user nova-compute[74932]: INFO nova.virt.libvirt.host [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] kernel doesn't support AMD SEV
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Libvirt baseline CPU <cpu>
Nov 03 16:18:44 user nova-compute[74932]:   <arch>x86_64</arch>
Nov 03 16:18:44 user nova-compute[74932]:   <model>Nehalem</model>
Nov 03 16:18:44 user nova-compute[74932]:   <vendor>Intel</vendor>
Nov 03 16:18:44 user nova-compute[74932]:   <topology sockets="6" cores="1" threads="1"/>
Nov 03 16:18:44 user nova-compute[74932]: </cpu>
Nov 03 16:18:44 user nova-compute[74932]:  {{(pid=74932) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Updated inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Updating resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 generation from 0 to 1 during operation: update_inventory {{(pid=74932) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Updating resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 generation from 1 to 2 during operation: update_traits {{(pid=74932) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.service [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Creating RPC server for service compute {{(pid=74932) start /opt/stack/nova/nova/service.py:182}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.service [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] Join ServiceGroup membership for this service compute {{(pid=74932) start /opt/stack/nova/nova/service.py:199}}
Nov 03 16:18:44 user nova-compute[74932]: DEBUG nova.servicegroup.drivers.db [None req-c0580813-8055-4eb4-adfa-f589f39202f4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74932) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 03 16:19:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:19:35 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:19:35 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:19:35 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=10361MB free_disk=26.036422729492188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:19:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:19:36 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:19:36 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:19:36 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:19:36 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:19:36 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:19:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:20:37 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:20:37 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:20:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=10327MB free_disk=26.100509643554688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:20:37 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:20:38 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:20:38 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:20:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:21:37 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:21:37 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:21:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=10348MB free_disk=25.856578826904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:21:37 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:21:38 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:21:38 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:21:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:21:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:21:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:22:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:37 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:22:38 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:22:38 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:22:38 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=9578MB free_disk=25.88284683227539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:22:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:22:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:22:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:22:49 user nova-compute[74932]: INFO nova.compute.claims [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Claim successful on node user
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:22:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:22:49 user nova-compute[74932]: INFO nova.compute.claims [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Claim successful on node user
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:22:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Creating image(s)
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "/opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "/opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "/opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:22:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:22:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.policy [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4bb8e6d69e4480983150ec4cd23a270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0b7a96b7504dd786bb63ee5504b40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:22:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Creating image(s)
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.policy [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd49e83fa0846d191cb4cf0719ba038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b101d0f7f99a41f699e3f2701cc35248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.virt.images [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] 8156ce23-7acb-4ad0-a7c3-910c755cd964 was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:22:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.part /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.part /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.converted" returned: 0 in 0.597s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.771s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:51 user nova-compute[74932]: INFO oslo.privsep.daemon [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7c3ujvp5/privsep.sock']
Nov 03 16:22:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.291s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:51 user sudo[84181]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7c3ujvp5/privsep.sock
Nov 03 16:22:51 user sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 16:22:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Successfully created port: 570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Successfully created port: 7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:22:53 user sudo[84181]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:53 user nova-compute[74932]: INFO oslo.privsep.daemon [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Spawned new privsep daemon via rootwrap
Nov 03 16:22:53 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 16:22:53 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 16:22:53 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 16:22:53 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84187
Nov 03 16:22:53 user nova-compute[74932]: WARNING oslo_privsep.priv_context [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] privsep daemon already running
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.212s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.156s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:22:53 user nova-compute[74932]: INFO nova.compute.claims [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Claim successful on node user
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk 1073741824" returned: 0 in 0.049s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.200s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.167s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.161s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk 1073741824" returned: 0 in 0.063s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Cannot resize image /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Ensure instance console log exists: /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:22:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Cannot resize image /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Ensure instance console log exists: /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.policy [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd6f5749c77427883db867a8de18c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a734f8e7b34fd1b14f878955a48490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:22:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Creating image(s)
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.164s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk 1073741824" returned: 0 in 0.047s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Cannot resize image /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Ensure instance console log exists: /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Successfully updated port: 570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquired lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Successfully updated port: 7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:22:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-changed-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Refreshing instance network info cache due to event network-changed-570732af-1616-4ec1-ba22-db22e3695659. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] Acquiring lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updating instance_info_cache with network_info: [{"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Releasing lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Instance network_info: |[{"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] Acquired lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Refreshing network info cache for port 570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Start _get_guest_xml network_info=[{"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:22:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:22:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1598000502',display_name='tempest-ServersNegativeTestJSON-server-1598000502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1598000502',id=1,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a0b7a96b7504dd786bb63ee5504b40d',ramdisk_id='',reservation_id='r-ol6mhx7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1609048425',owner_user_name='tempest-ServersNegativeTestJSON-1609048425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:22:50Z,user_data=None,user_id='c4bb8e6d69e4480983150ec4cd23a270',uuid=d94f2ba8-e23e-497c-aa29-b282d9bd79e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converting VIF {"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.objects.instance [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lazy-loading 'pci_devices' on Instance uuid d94f2ba8-e23e-497c-aa29-b282d9bd79e9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:22:56 user nova-compute[74932]:   <uuid>d94f2ba8-e23e-497c-aa29-b282d9bd79e9</uuid>
Nov 03 16:22:56 user nova-compute[74932]:   <name>instance-00000001</name>
Nov 03 16:22:56 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:22:56 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:22:56 user nova-compute[74932]:   <metadata>
Nov 03 16:22:56 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:22:56 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:name>tempest-ServersNegativeTestJSON-server-1598000502</nova:name>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:22:56</nova:creationTime>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:22:56 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:22:56 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:owner>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:user uuid="c4bb8e6d69e4480983150ec4cd23a270">tempest-ServersNegativeTestJSON-1609048425-project-member</nova:user>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:project uuid="9a0b7a96b7504dd786bb63ee5504b40d">tempest-ServersNegativeTestJSON-1609048425</nova:project>
Nov 03 16:22:56 user nova-compute[74932]:       </nova:owner>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:ports>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:port uuid="570732af-1616-4ec1-ba22-db22e3695659">
Nov 03 16:22:56 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 16:22:56 user nova-compute[74932]:         </nova:port>
Nov 03 16:22:56 user nova-compute[74932]:       </nova:ports>
Nov 03 16:22:56 user nova-compute[74932]:     </nova:instance>
Nov 03 16:22:56 user nova-compute[74932]:   </metadata>
Nov 03 16:22:56 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:22:56 user nova-compute[74932]:     <system>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="serial">d94f2ba8-e23e-497c-aa29-b282d9bd79e9</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="uuid">d94f2ba8-e23e-497c-aa29-b282d9bd79e9</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:22:56 user nova-compute[74932]:     </system>
Nov 03 16:22:56 user nova-compute[74932]:   </sysinfo>
Nov 03 16:22:56 user nova-compute[74932]:   <os>
Nov 03 16:22:56 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:22:56 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:22:56 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:22:56 user nova-compute[74932]:   </os>
Nov 03 16:22:56 user nova-compute[74932]:   <features>
Nov 03 16:22:56 user nova-compute[74932]:     <acpi/>
Nov 03 16:22:56 user nova-compute[74932]:     <apic/>
Nov 03 16:22:56 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:22:56 user nova-compute[74932]:   </features>
Nov 03 16:22:56 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:22:56 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:22:56 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:22:56 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:22:56 user nova-compute[74932]:   </clock>
Nov 03 16:22:56 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:22:56 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:22:56 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:22:56 user nova-compute[74932]:   </cpu>
Nov 03 16:22:56 user nova-compute[74932]:   <devices>
Nov 03 16:22:56 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:22:56 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:22:56 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk"/>
Nov 03 16:22:56 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:22:56 user nova-compute[74932]:     </disk>
Nov 03 16:22:56 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:22:56 user nova-compute[74932]:       <mac address="fa:16:3e:41:0e:3b"/>
Nov 03 16:22:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:22:56 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:22:56 user nova-compute[74932]:       <target dev="tap570732af-16"/>
Nov 03 16:22:56 user nova-compute[74932]:     </interface>
Nov 03 16:22:56 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:22:56 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/console.log" append="off"/>
Nov 03 16:22:56 user nova-compute[74932]:     </serial>
Nov 03 16:22:56 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:22:56 user nova-compute[74932]:     <video>
Nov 03 16:22:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:22:56 user nova-compute[74932]:     </video>
Nov 03 16:22:56 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:22:56 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:22:56 user nova-compute[74932]:     </rng>
Nov 03 16:22:56 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:22:56 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:22:56 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:22:56 user nova-compute[74932]:     </memballoon>
Nov 03 16:22:56 user nova-compute[74932]:   </devices>
Nov 03 16:22:56 user nova-compute[74932]: </domain>
Nov 03 16:22:56 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1598000502',display_name='tempest-ServersNegativeTestJSON-server-1598000502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1598000502',id=1,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a0b7a96b7504dd786bb63ee5504b40d',ramdisk_id='',reservation_id='r-ol6mhx7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1609048425',owner_user_name='tempest-ServersNegativeTestJSON-1609048425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:22:50Z,user_data=None,user_id='c4bb8e6d69e4480983150ec4cd23a270',uuid=d94f2ba8-e23e-497c-aa29-b282d9bd79e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converting VIF {"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG os_vif [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Created schema index Interface.name {{(pid=74932) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Created schema index Port.name {{(pid=74932) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Created schema index Bridge.name {{(pid=74932) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [POLLOUT] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed884664-f00c-5787-9e58-168aa3dbe06d', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: INFO oslo.privsep.daemon [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpc9tvj1rz/privsep.sock']
Nov 03 16:22:56 user sudo[84261]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpc9tvj1rz/privsep.sock
Nov 03 16:22:56 user sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 16:22:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance network_info: |[{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Start _get_guest_xml network_info=[{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:22:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:22:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Successfully created port: 7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1869007814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1869007814',id=2,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmRIEWkvnhfWBt9oMf696eo2xeNdm00BGflZzefY/+obY9+I9ANGBdmGwFI0a77BskqR999jg/4fFbW++fyYLZHccvBY8rwrABCqJwA+E9VxffX4qIlgdv/EMbjlWBkqQ==',key_name='tempest-keypair-271065144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-me8mqfb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=0238b778-b9e2-4a5b-82f2-5d58a6a552e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.objects.instance [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'pci_devices' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:22:56 user nova-compute[74932]:   <uuid>0238b778-b9e2-4a5b-82f2-5d58a6a552e7</uuid>
Nov 03 16:22:56 user nova-compute[74932]:   <name>instance-00000002</name>
Nov 03 16:22:56 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:22:56 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:22:56 user nova-compute[74932]:   <metadata>
Nov 03 16:22:56 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:22:56 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1869007814</nova:name>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:22:56</nova:creationTime>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:22:56 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:22:56 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:owner>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:user uuid="6fd49e83fa0846d191cb4cf0719ba038">tempest-AttachVolumeShelveTestJSON-1586732873-project-member</nova:user>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:project uuid="b101d0f7f99a41f699e3f2701cc35248">tempest-AttachVolumeShelveTestJSON-1586732873</nova:project>
Nov 03 16:22:56 user nova-compute[74932]:       </nova:owner>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:22:56 user nova-compute[74932]:       <nova:ports>
Nov 03 16:22:56 user nova-compute[74932]:         <nova:port uuid="7d0caef5-f058-4eca-b838-2cf6bf7cae2d">
Nov 03 16:22:56 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 16:22:56 user nova-compute[74932]:         </nova:port>
Nov 03 16:22:56 user nova-compute[74932]:       </nova:ports>
Nov 03 16:22:56 user nova-compute[74932]:     </nova:instance>
Nov 03 16:22:56 user nova-compute[74932]:   </metadata>
Nov 03 16:22:56 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:22:56 user nova-compute[74932]:     <system>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="serial">0238b778-b9e2-4a5b-82f2-5d58a6a552e7</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="uuid">0238b778-b9e2-4a5b-82f2-5d58a6a552e7</entry>
Nov 03 16:22:56 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:22:56 user nova-compute[74932]:     </system>
Nov 03 16:22:56 user nova-compute[74932]:   </sysinfo>
Nov 03 16:22:56 user nova-compute[74932]:   <os>
Nov 03 16:22:56 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:22:56 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:22:56 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:22:56 user nova-compute[74932]:   </os>
Nov 03 16:22:56 user nova-compute[74932]:   <features>
Nov 03 16:22:56 user nova-compute[74932]:     <acpi/>
Nov 03 16:22:56 user nova-compute[74932]:     <apic/>
Nov 03 16:22:56 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:22:56 user nova-compute[74932]:   </features>
Nov 03 16:22:56 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:22:56 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:22:56 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:22:56 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:22:56 user nova-compute[74932]:   </clock>
Nov 03 16:22:56 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:22:56 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:22:56 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:22:56 user nova-compute[74932]:   </cpu>
Nov 03 16:22:56 user nova-compute[74932]:   <devices>
Nov 03 16:22:56 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:22:56 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:22:56 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk"/>
Nov 03 16:22:56 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:22:56 user nova-compute[74932]:     </disk>
Nov 03 16:22:56 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:22:56 user nova-compute[74932]:       <mac address="fa:16:3e:39:ca:4b"/>
Nov 03 16:22:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:22:56 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:22:56 user nova-compute[74932]:       <target dev="tap7d0caef5-f0"/>
Nov 03 16:22:56 user nova-compute[74932]:     </interface>
Nov 03 16:22:56 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:22:56 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/console.log" append="off"/>
Nov 03 16:22:56 user nova-compute[74932]:     </serial>
Nov 03 16:22:56 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:22:56 user nova-compute[74932]:     <video>
Nov 03 16:22:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:22:56 user nova-compute[74932]:     </video>
Nov 03 16:22:56 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:22:56 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:22:56 user nova-compute[74932]:     </rng>
Nov 03 16:22:56 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:22:56 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:22:56 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:22:56 user nova-compute[74932]:     </memballoon>
Nov 03 16:22:56 user nova-compute[74932]:   </devices>
Nov 03 16:22:56 user nova-compute[74932]: </domain>
Nov 03 16:22:56 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1869007814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1869007814',id=2,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmRIEWkvnhfWBt9oMf696eo2xeNdm00BGflZzefY/+obY9+I9ANGBdmGwFI0a77BskqR999jg/4fFbW++fyYLZHccvBY8rwrABCqJwA+E9VxffX4qIlgdv/EMbjlWBkqQ==',key_name='tempest-keypair-271065144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-me8mqfb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=0238b778-b9e2-4a5b-82f2-5d58a6a552e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG os_vif [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '701ce5c6-0f6f-5b78-86b3-5f5bc190e83e', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:22:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updated VIF entry in instance network info cache for port 570732af-1616-4ec1-ba22-db22e3695659. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:22:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updating instance_info_cache with network_info: [{"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:22:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f14d6fcb-70f3-49e7-a712-845aa4d3c807 req-8b50daeb-8675-4ca7-80ac-de1cc587aa89 service nova] Releasing lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:22:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing instance network info cache due to event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:22:58 user sudo[84261]: pam_unix(sudo:session): session closed for user root
Nov 03 16:22:58 user nova-compute[74932]: INFO oslo.privsep.daemon [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Spawned new privsep daemon via rootwrap
Nov 03 16:22:58 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 16:22:58 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 16:22:58 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 03 16:22:58 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84273
Nov 03 16:22:58 user nova-compute[74932]: WARNING oslo_privsep.priv_context [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] privsep daemon already running
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap570732af-16, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap570732af-16, col_values=(('qos', UUID('0166b963-c956-46eb-a8ed-2d61de3b2059')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap570732af-16, col_values=(('external_ids', {'iface-id': '570732af-1616-4ec1-ba22-db22e3695659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:0e:3b', 'vm-uuid': 'd94f2ba8-e23e-497c-aa29-b282d9bd79e9'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d0caef5-f0, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d0caef5-f0, col_values=(('qos', UUID('6e41f14c-4107-4430-b46f-0e9b1e09898d')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d0caef5-f0, col_values=(('external_ids', {'iface-id': '7d0caef5-f058-4eca-b838-2cf6bf7cae2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ca:4b', 'vm-uuid': '0238b778-b9e2-4a5b-82f2-5d58a6a552e7'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:22:58 user nova-compute[74932]: INFO os_vif [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16')
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:22:58 user nova-compute[74932]: INFO os_vif [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0')
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] No VIF found with MAC fa:16:3e:41:0e:3b, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No VIF found with MAC fa:16:3e:39:ca:4b, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updated VIF entry in instance network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:22:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5ccb77e-ab60-4692-a78e-9f4b253d942e req-55d7ebe5-0c34-4b0b-867b-86ba85b64d63 service nova] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Successfully updated port: 7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-changed-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Refreshing instance network info cache due to event network-changed-7ab56479-82d0-433f-a971-d25a3edff1ed. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:23:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.network.neutron [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance network_info: |[{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Refreshing network info cache for port 7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start _get_guest_xml network_info=[{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:23:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.objects.instance [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'pci_devices' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:23:01 user nova-compute[74932]:   <uuid>cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</uuid>
Nov 03 16:23:01 user nova-compute[74932]:   <name>instance-00000003</name>
Nov 03 16:23:01 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:23:01 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:23:01 user nova-compute[74932]:   <metadata>
Nov 03 16:23:01 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:23:01 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:23:01 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherB-server-103654683</nova:name>
Nov 03 16:23:01 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:23:01</nova:creationTime>
Nov 03 16:23:01 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:23:01 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:23:01 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:23:01 user nova-compute[74932]:       <nova:owner>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:user uuid="bcd6f5749c77427883db867a8de18c2f">tempest-ServerActionsTestOtherB-2075500504-project-member</nova:user>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:project uuid="e4a734f8e7b34fd1b14f878955a48490">tempest-ServerActionsTestOtherB-2075500504</nova:project>
Nov 03 16:23:01 user nova-compute[74932]:       </nova:owner>
Nov 03 16:23:01 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:23:01 user nova-compute[74932]:       <nova:ports>
Nov 03 16:23:01 user nova-compute[74932]:         <nova:port uuid="7ab56479-82d0-433f-a971-d25a3edff1ed">
Nov 03 16:23:01 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:23:01 user nova-compute[74932]:         </nova:port>
Nov 03 16:23:01 user nova-compute[74932]:       </nova:ports>
Nov 03 16:23:01 user nova-compute[74932]:     </nova:instance>
Nov 03 16:23:01 user nova-compute[74932]:   </metadata>
Nov 03 16:23:01 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:23:01 user nova-compute[74932]:     <system>
Nov 03 16:23:01 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:23:01 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:23:01 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:23:01 user nova-compute[74932]:       <entry name="serial">cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</entry>
Nov 03 16:23:01 user nova-compute[74932]:       <entry name="uuid">cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</entry>
Nov 03 16:23:01 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:23:01 user nova-compute[74932]:     </system>
Nov 03 16:23:01 user nova-compute[74932]:   </sysinfo>
Nov 03 16:23:01 user nova-compute[74932]:   <os>
Nov 03 16:23:01 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:23:01 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:23:01 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:23:01 user nova-compute[74932]:   </os>
Nov 03 16:23:01 user nova-compute[74932]:   <features>
Nov 03 16:23:01 user nova-compute[74932]:     <acpi/>
Nov 03 16:23:01 user nova-compute[74932]:     <apic/>
Nov 03 16:23:01 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:23:01 user nova-compute[74932]:   </features>
Nov 03 16:23:01 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:23:01 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:23:01 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:23:01 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:23:01 user nova-compute[74932]:   </clock>
Nov 03 16:23:01 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:23:01 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:23:01 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:23:01 user nova-compute[74932]:   </cpu>
Nov 03 16:23:01 user nova-compute[74932]:   <devices>
Nov 03 16:23:01 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:23:01 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:23:01 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk"/>
Nov 03 16:23:01 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:23:01 user nova-compute[74932]:     </disk>
Nov 03 16:23:01 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:23:01 user nova-compute[74932]:       <mac address="fa:16:3e:d0:fa:36"/>
Nov 03 16:23:01 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:01 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:23:01 user nova-compute[74932]:       <target dev="tap7ab56479-82"/>
Nov 03 16:23:01 user nova-compute[74932]:     </interface>
Nov 03 16:23:01 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:23:01 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/console.log" append="off"/>
Nov 03 16:23:01 user nova-compute[74932]:     </serial>
Nov 03 16:23:01 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:23:01 user nova-compute[74932]:     <video>
Nov 03 16:23:01 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:01 user nova-compute[74932]:     </video>
Nov 03 16:23:01 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:23:01 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:23:01 user nova-compute[74932]:     </rng>
Nov 03 16:23:01 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:23:01 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:23:01 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:23:01 user nova-compute[74932]:     </memballoon>
Nov 03 16:23:01 user nova-compute[74932]:   </devices>
Nov 03 16:23:01 user nova-compute[74932]: </domain>
Nov 03 16:23:01 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG os_vif [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eb53e9d-7f4a-5fa6-aa92-27a931162e08', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ab56479-82, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ab56479-82, col_values=(('qos', UUID('287a5bfc-393a-4d81-9413-c1ba0de28c9d')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ab56479-82, col_values=(('external_ids', {'iface-id': '7ab56479-82d0-433f-a971-d25a3edff1ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fa:36', 'vm-uuid': 'cb4bd028-91a8-489d-ab27-e5dc6d75a7b7'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:01 user nova-compute[74932]: INFO os_vif [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82')
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:23:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No VIF found with MAC fa:16:3e:d0:fa:36, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:23:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:03 user nova-compute[74932]: DEBUG nova.network.neutron [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updated VIF entry in instance network info cache for port 7ab56479-82d0-433f-a971-d25a3edff1ed. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:23:03 user nova-compute[74932]: DEBUG nova.network.neutron [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c500e6fa-5b1b-4f00-817a-64515e3d914d req-cb9d1f53-6d34-4e14-b95a-b2dac15903a8 service nova] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance spawned successfully.
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:04 user nova-compute[74932]: INFO nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Took 13.97 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:04 user nova-compute[74932]: INFO nova.compute.manager [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Took 14.84 seconds to build instance.
Nov 03 16:23:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-830136fa-d9a1-4522-8cf2-5acd4b01fc87 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.021s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:05 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Instance spawned successfully.
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:05 user nova-compute[74932]: INFO nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Took 15.58 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:05 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:05 user nova-compute[74932]: INFO nova.compute.manager [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Took 16.46 seconds to build instance.
Nov 03 16:23:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0d6e2c76-7afa-4475-98da-b303b7a5345e tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.937s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:06 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance spawned successfully.
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:06 user nova-compute[74932]: INFO nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Took 11.93 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:06 user nova-compute[74932]: INFO nova.compute.manager [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Took 12.99 seconds to build instance.
Nov 03 16:23:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-46ba9983-9cfd-446a-a38a-c4dd7bf3f26d tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.221s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-3d57436b-0941-48de-aa66-65cd9cc04ad7 req-51e9e28c-97cf-4398-bc1d-4fc27b265dda service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3d57436b-0941-48de-aa66-65cd9cc04ad7 req-51e9e28c-97cf-4398-bc1d-4fc27b265dda service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3d57436b-0941-48de-aa66-65cd9cc04ad7 req-51e9e28c-97cf-4398-bc1d-4fc27b265dda service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3d57436b-0941-48de-aa66-65cd9cc04ad7 req-51e9e28c-97cf-4398-bc1d-4fc27b265dda service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-3d57436b-0941-48de-aa66-65cd9cc04ad7 req-51e9e28c-97cf-4398-bc1d-4fc27b265dda service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:09 user nova-compute[74932]: WARNING nova.compute.manager [req-3d57436b-0941-48de-aa66-65cd9cc04ad7 req-51e9e28c-97cf-4398-bc1d-4fc27b265dda service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state None.
Nov 03 16:23:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-226ac0a3-56ff-4d02-ba1c-343cd222a3f5 req-e19fb4e5-b2b6-4a21-aac8-401d3341aafc service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-226ac0a3-56ff-4d02-ba1c-343cd222a3f5 req-e19fb4e5-b2b6-4a21-aac8-401d3341aafc service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-226ac0a3-56ff-4d02-ba1c-343cd222a3f5 req-e19fb4e5-b2b6-4a21-aac8-401d3341aafc service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-226ac0a3-56ff-4d02-ba1c-343cd222a3f5 req-e19fb4e5-b2b6-4a21-aac8-401d3341aafc service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-226ac0a3-56ff-4d02-ba1c-343cd222a3f5 req-e19fb4e5-b2b6-4a21-aac8-401d3341aafc service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:11 user nova-compute[74932]: WARNING nova.compute.manager [req-226ac0a3-56ff-4d02-ba1c-343cd222a3f5 req-e19fb4e5-b2b6-4a21-aac8-401d3341aafc service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state None.
Nov 03 16:23:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:23:15 user nova-compute[74932]: INFO nova.compute.claims [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Claim successful on node user
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.network.neutron [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:23:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.policy [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f75f8149b74615b3a1e3cf77de2d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb89089043442b980d4d230bb608ad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:23:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Creating image(s)
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "/opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "/opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.286s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk 1073741824" returned: 0 in 0.064s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.276s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:16 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:23:16 user nova-compute[74932]: INFO nova.compute.claims [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Claim successful on node user
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Cannot resize image /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Ensure instance console log exists: /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Successfully created port: 64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.197s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:23:17 user nova-compute[74932]: INFO nova.compute.claims [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Claim successful on node user
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:23:17 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:23:17 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Creating image(s)
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "/opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "/opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "747e4ee6ddf06a309f636ee27ee4676533d7c4ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "747e4ee6ddf06a309f636ee27ee4676533d7c4ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Successfully updated port: 64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquired lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.policy [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd86959c9099144e2855ce994e8e76f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf23fb278af4fa78737e5d2e20b00a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-changed-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Refreshing instance network info cache due to event network-changed-64a184b0-edac-44db-89ce-63db6e13706b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:23:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] Acquiring lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.network.neutron [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.926s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.part --force-share --output=json" returned: 0 in 0.232s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.virt.images [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] 5f5bea02-2093-495f-a621-678ee64918b5 was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.part /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.network.neutron [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:23:18 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.network.neutron [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updating instance_info_cache with network_info: [{"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Releasing lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Instance network_info: |[{"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] Acquired lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.network.neutron [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Refreshing network info cache for port 64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:23:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Start _get_guest_xml network_info=[{"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:23:19 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:19 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1374950441',display_name='tempest-VolumesAdminNegativeTest-server-1374950441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1374950441',id=4,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbien2zUyTqPgttejhARqEL8/UpoP40PC4629F3+t/DmKF4JuheaabYTHUsHAQW0LdbwHu/tA/m4WkQAFleeqB6Ro7oFInMBCODMaZns2aeJnp5/fvO8zTNiwF8j7L/Tg==',key_name='tempest-keypair-1688586843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb89089043442b980d4d230bb608ad6',ramdisk_id='',reservation_id='r-j0wpy6z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-164723280',owner_user_name='tempest-VolumesAdminNegativeTest-164723280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f75f8149b74615b3a1e3cf77de2d5e',uuid=03f9c482-d1ad-4300-9be3-afc2e0b0bade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converting VIF {"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.objects.instance [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.policy [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cce04e168f2f441fa42c0e7c75c72e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17204819840482d90ec72ef703b2eea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:23:19 user nova-compute[74932]:   <uuid>03f9c482-d1ad-4300-9be3-afc2e0b0bade</uuid>
Nov 03 16:23:19 user nova-compute[74932]:   <name>instance-00000004</name>
Nov 03 16:23:19 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:23:19 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:23:19 user nova-compute[74932]:   <metadata>
Nov 03 16:23:19 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:23:19 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:23:19 user nova-compute[74932]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1374950441</nova:name>
Nov 03 16:23:19 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:23:19</nova:creationTime>
Nov 03 16:23:19 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:23:19 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:23:19 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:23:19 user nova-compute[74932]:       <nova:owner>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:user uuid="21f75f8149b74615b3a1e3cf77de2d5e">tempest-VolumesAdminNegativeTest-164723280-project-member</nova:user>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:project uuid="eeb89089043442b980d4d230bb608ad6">tempest-VolumesAdminNegativeTest-164723280</nova:project>
Nov 03 16:23:19 user nova-compute[74932]:       </nova:owner>
Nov 03 16:23:19 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:23:19 user nova-compute[74932]:       <nova:ports>
Nov 03 16:23:19 user nova-compute[74932]:         <nova:port uuid="64a184b0-edac-44db-89ce-63db6e13706b">
Nov 03 16:23:19 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 16:23:19 user nova-compute[74932]:         </nova:port>
Nov 03 16:23:19 user nova-compute[74932]:       </nova:ports>
Nov 03 16:23:19 user nova-compute[74932]:     </nova:instance>
Nov 03 16:23:19 user nova-compute[74932]:   </metadata>
Nov 03 16:23:19 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:23:19 user nova-compute[74932]:     <system>
Nov 03 16:23:19 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:23:19 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:23:19 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:23:19 user nova-compute[74932]:       <entry name="serial">03f9c482-d1ad-4300-9be3-afc2e0b0bade</entry>
Nov 03 16:23:19 user nova-compute[74932]:       <entry name="uuid">03f9c482-d1ad-4300-9be3-afc2e0b0bade</entry>
Nov 03 16:23:19 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:23:19 user nova-compute[74932]:     </system>
Nov 03 16:23:19 user nova-compute[74932]:   </sysinfo>
Nov 03 16:23:19 user nova-compute[74932]:   <os>
Nov 03 16:23:19 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:23:19 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:23:19 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:23:19 user nova-compute[74932]:   </os>
Nov 03 16:23:19 user nova-compute[74932]:   <features>
Nov 03 16:23:19 user nova-compute[74932]:     <acpi/>
Nov 03 16:23:19 user nova-compute[74932]:     <apic/>
Nov 03 16:23:19 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:23:19 user nova-compute[74932]:   </features>
Nov 03 16:23:19 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:23:19 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:23:19 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:23:19 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:23:19 user nova-compute[74932]:   </clock>
Nov 03 16:23:19 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:23:19 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:23:19 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:23:19 user nova-compute[74932]:   </cpu>
Nov 03 16:23:19 user nova-compute[74932]:   <devices>
Nov 03 16:23:19 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:23:19 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:23:19 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk"/>
Nov 03 16:23:19 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:23:19 user nova-compute[74932]:     </disk>
Nov 03 16:23:19 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:23:19 user nova-compute[74932]:       <mac address="fa:16:3e:e2:47:8f"/>
Nov 03 16:23:19 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:19 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:23:19 user nova-compute[74932]:       <target dev="tap64a184b0-ed"/>
Nov 03 16:23:19 user nova-compute[74932]:     </interface>
Nov 03 16:23:19 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:23:19 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/console.log" append="off"/>
Nov 03 16:23:19 user nova-compute[74932]:     </serial>
Nov 03 16:23:19 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:23:19 user nova-compute[74932]:     <video>
Nov 03 16:23:19 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:19 user nova-compute[74932]:     </video>
Nov 03 16:23:19 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:23:19 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:23:19 user nova-compute[74932]:     </rng>
Nov 03 16:23:19 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:23:19 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:23:19 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:23:19 user nova-compute[74932]:     </memballoon>
Nov 03 16:23:19 user nova-compute[74932]:   </devices>
Nov 03 16:23:19 user nova-compute[74932]: </domain>
Nov 03 16:23:19 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1374950441',display_name='tempest-VolumesAdminNegativeTest-server-1374950441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1374950441',id=4,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbien2zUyTqPgttejhARqEL8/UpoP40PC4629F3+t/DmKF4JuheaabYTHUsHAQW0LdbwHu/tA/m4WkQAFleeqB6Ro7oFInMBCODMaZns2aeJnp5/fvO8zTNiwF8j7L/Tg==',key_name='tempest-keypair-1688586843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb89089043442b980d4d230bb608ad6',ramdisk_id='',reservation_id='r-j0wpy6z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-164723280',owner_user_name='tempest-VolumesAdminNegativeTest-164723280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f75f8149b74615b3a1e3cf77de2d5e',uuid=03f9c482-d1ad-4300-9be3-afc2e0b0bade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converting VIF {"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG os_vif [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d7dd682-8c4b-5063-a3c8-26afe4fea1f7', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.part /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.converted" returned: 0 in 0.466s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:23:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Creating image(s)
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "/opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "/opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "/opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64a184b0-ed, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64a184b0-ed, col_values=(('qos', UUID('1182fad4-1a01-4a88-8036-dc9f60ec9c06')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64a184b0-ed, col_values=(('external_ids', {'iface-id': '64a184b0-edac-44db-89ce-63db6e13706b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:47:8f', 'vm-uuid': '03f9c482-d1ad-4300-9be3-afc2e0b0bade'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:19 user nova-compute[74932]: INFO os_vif [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed')
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "747e4ee6ddf06a309f636ee27ee4676533d7c4ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.595s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No VIF found with MAC fa:16:3e:e2:47:8f, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updated VIF entry in instance network info cache for port 64a184b0-edac-44db-89ce-63db6e13706b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updating instance_info_cache with network_info: [{"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-239cadfc-f6d1-4267-8ce2-fd6a8e30fd8d req-e5f744b8-83ff-4b33-9204-f250a97a07e9 service nova] Releasing lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab --force-share --output=json" returned: 0 in 0.206s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "747e4ee6ddf06a309f636ee27ee4676533d7c4ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "747e4ee6ddf06a309f636ee27ee4676533d7c4ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk 1073741824" returned: 0 in 0.058s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab,backing_fmt=raw /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab,backing_fmt=raw /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk 1073741824" returned: 0 in 0.052s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "747e4ee6ddf06a309f636ee27ee4676533d7c4ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.203s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Cannot resize image /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Ensure instance console log exists: /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/747e4ee6ddf06a309f636ee27ee4676533d7c4ab --force-share --output=json" returned: 0 in 0.315s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Cannot resize image /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Ensure instance console log exists: /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.network.neutron [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Successfully created port: dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:20 user nova-compute[74932]: DEBUG nova.network.neutron [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Successfully created port: 20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG nova.network.neutron [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Successfully updated port: dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquired lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG nova.network.neutron [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG nova.network.neutron [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-changed-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Refreshing instance network info cache due to event network-changed-dccc0acb-ffa9-4417-bdf3-445b09723240. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] Acquiring lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Successfully updated port: 20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquired lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating instance_info_cache with network_info: [{"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Releasing lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Instance network_info: |[{"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] Acquired lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Refreshing network info cache for port dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Start _get_guest_xml network_info=[{"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:23:22 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:22 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-326517297',display_name='tempest-TestVolumeSwap-server-326517297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-326517297',id=6,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhF/CaENgrOF50x8+oquDtYy2wHP0n7LfWpuvfSWUcPoxLshSpd+VQ8pyYktRA7ZvvGIIjmU0lQehdR1i+Whqy2ya+Tl7WsaRPW/eI4TDIgDtaHp0cG0OhLOddjkW7Qfg==',key_name='tempest-keypair-592199101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17204819840482d90ec72ef703b2eea',ramdisk_id='',reservation_id='r-3rbp77rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-220001656',owner_user_name='tempest-TestVolumeSwap-220001656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cce04e168f2f441fa42c0e7c75c72e17',uuid=be942262-61f1-452b-bda1-5185b321477b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Converting VIF {"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.objects.instance [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lazy-loading 'pci_devices' on Instance uuid be942262-61f1-452b-bda1-5185b321477b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:23:22 user nova-compute[74932]:   <uuid>be942262-61f1-452b-bda1-5185b321477b</uuid>
Nov 03 16:23:22 user nova-compute[74932]:   <name>instance-00000006</name>
Nov 03 16:23:22 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:23:22 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:23:22 user nova-compute[74932]:   <metadata>
Nov 03 16:23:22 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:23:22 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:23:22 user nova-compute[74932]:       <nova:name>tempest-TestVolumeSwap-server-326517297</nova:name>
Nov 03 16:23:22 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:23:22</nova:creationTime>
Nov 03 16:23:22 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:23:22 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:23:22 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:23:22 user nova-compute[74932]:       <nova:owner>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:user uuid="cce04e168f2f441fa42c0e7c75c72e17">tempest-TestVolumeSwap-220001656-project-member</nova:user>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:project uuid="c17204819840482d90ec72ef703b2eea">tempest-TestVolumeSwap-220001656</nova:project>
Nov 03 16:23:22 user nova-compute[74932]:       </nova:owner>
Nov 03 16:23:22 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:23:22 user nova-compute[74932]:       <nova:ports>
Nov 03 16:23:22 user nova-compute[74932]:         <nova:port uuid="dccc0acb-ffa9-4417-bdf3-445b09723240">
Nov 03 16:23:22 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:23:22 user nova-compute[74932]:         </nova:port>
Nov 03 16:23:22 user nova-compute[74932]:       </nova:ports>
Nov 03 16:23:22 user nova-compute[74932]:     </nova:instance>
Nov 03 16:23:22 user nova-compute[74932]:   </metadata>
Nov 03 16:23:22 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:23:22 user nova-compute[74932]:     <system>
Nov 03 16:23:22 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:23:22 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:23:22 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:23:22 user nova-compute[74932]:       <entry name="serial">be942262-61f1-452b-bda1-5185b321477b</entry>
Nov 03 16:23:22 user nova-compute[74932]:       <entry name="uuid">be942262-61f1-452b-bda1-5185b321477b</entry>
Nov 03 16:23:22 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:23:22 user nova-compute[74932]:     </system>
Nov 03 16:23:22 user nova-compute[74932]:   </sysinfo>
Nov 03 16:23:22 user nova-compute[74932]:   <os>
Nov 03 16:23:22 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:23:22 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:23:22 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:23:22 user nova-compute[74932]:   </os>
Nov 03 16:23:22 user nova-compute[74932]:   <features>
Nov 03 16:23:22 user nova-compute[74932]:     <acpi/>
Nov 03 16:23:22 user nova-compute[74932]:     <apic/>
Nov 03 16:23:22 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:23:22 user nova-compute[74932]:   </features>
Nov 03 16:23:22 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:23:22 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:23:22 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:23:22 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:23:22 user nova-compute[74932]:   </clock>
Nov 03 16:23:22 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:23:22 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:23:22 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:23:22 user nova-compute[74932]:   </cpu>
Nov 03 16:23:22 user nova-compute[74932]:   <devices>
Nov 03 16:23:22 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:23:22 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:23:22 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk"/>
Nov 03 16:23:22 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:23:22 user nova-compute[74932]:     </disk>
Nov 03 16:23:22 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:23:22 user nova-compute[74932]:       <mac address="fa:16:3e:8e:98:92"/>
Nov 03 16:23:22 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:22 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:23:22 user nova-compute[74932]:       <target dev="tapdccc0acb-ff"/>
Nov 03 16:23:22 user nova-compute[74932]:     </interface>
Nov 03 16:23:22 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:23:22 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/console.log" append="off"/>
Nov 03 16:23:22 user nova-compute[74932]:     </serial>
Nov 03 16:23:22 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:23:22 user nova-compute[74932]:     <video>
Nov 03 16:23:22 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:22 user nova-compute[74932]:     </video>
Nov 03 16:23:22 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:23:22 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:23:22 user nova-compute[74932]:     </rng>
Nov 03 16:23:22 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:23:22 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:23:22 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:23:22 user nova-compute[74932]:     </memballoon>
Nov 03 16:23:22 user nova-compute[74932]:   </devices>
Nov 03 16:23:22 user nova-compute[74932]: </domain>
Nov 03 16:23:22 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-326517297',display_name='tempest-TestVolumeSwap-server-326517297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-326517297',id=6,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhF/CaENgrOF50x8+oquDtYy2wHP0n7LfWpuvfSWUcPoxLshSpd+VQ8pyYktRA7ZvvGIIjmU0lQehdR1i+Whqy2ya+Tl7WsaRPW/eI4TDIgDtaHp0cG0OhLOddjkW7Qfg==',key_name='tempest-keypair-592199101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17204819840482d90ec72ef703b2eea',ramdisk_id='',reservation_id='r-3rbp77rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-220001656',owner_user_name='tempest-TestVolumeSwap-220001656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cce04e168f2f441fa42c0e7c75c72e17',uuid=be942262-61f1-452b-bda1-5185b321477b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Converting VIF {"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG os_vif [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08ce3c4d-e1af-53d2-9565-1aebd3098ffc', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdccc0acb-ff, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdccc0acb-ff, col_values=(('qos', UUID('a486c3e7-4012-421c-b461-58866bead5d5')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdccc0acb-ff, col_values=(('external_ids', {'iface-id': 'dccc0acb-ffa9-4417-bdf3-445b09723240', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:98:92', 'vm-uuid': 'be942262-61f1-452b-bda1-5185b321477b'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:22 user nova-compute[74932]: INFO os_vif [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff')
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] No VIF found with MAC fa:16:3e:8e:98:92, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Updated VIF entry in instance network info cache for port dccc0acb-ffa9-4417-bdf3-445b09723240. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating instance_info_cache with network_info: [{"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-053ba498-7196-4d40-8d37-6824e623d8ed req-d42ddc58-a191-444c-88f8-40d13f7b932a service nova] Releasing lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updating instance_info_cache with network_info: [{"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Releasing lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Instance network_info: |[{"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Start _get_guest_xml network_info=[{"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:23:09Z,direct_url=<?>,disk_format='qcow2',id=5f5bea02-2093-495f-a621-678ee64918b5,min_disk=0,min_ram=0,name='',owner='25f05413824d4dd58f2b26b177b60e22',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:23:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'image_id': '5f5bea02-2093-495f-a621-678ee64918b5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:23:22 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:22 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:23:09Z,direct_url=<?>,disk_format='qcow2',id=5f5bea02-2093-495f-a621-678ee64918b5,min_disk=0,min_ram=0,name='',owner='25f05413824d4dd58f2b26b177b60e22',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:23:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:23:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1419577564',display_name='tempest-AttachSCSIVolumeTestJSON-server-1419577564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1419577564',id=5,image_ref='5f5bea02-2093-495f-a621-678ee64918b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5ul8HM0L2dn2OQV8NeqtHUeIokr5gWbPVndmcGu3ussKu41aM6YSKRSWhuY5+B/XhrqWCYg59tXGv8fAi1mv8/ceMkdpSbf5IfGKtNFFlWmAgrrDMFNIWMhmdghfQGOQ==',key_name='tempest-keypair-68860100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bf23fb278af4fa78737e5d2e20b00a8',ramdisk_id='',reservation_id='r-nym64i9r',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f5bea02-2093-495f-a621-678ee64918b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-739319920',owner_user_name='tempest-AttachSCSIVolumeTestJSON-739319920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d86959c9099144e2855ce994e8e76f6b',uuid=1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Converting VIF {"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.objects.instance [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:23:23 user nova-compute[74932]:   <uuid>1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff</uuid>
Nov 03 16:23:23 user nova-compute[74932]:   <name>instance-00000005</name>
Nov 03 16:23:23 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:23:23 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:23:23 user nova-compute[74932]:   <metadata>
Nov 03 16:23:23 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:23:23 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:23:23 user nova-compute[74932]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1419577564</nova:name>
Nov 03 16:23:23 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:23:22</nova:creationTime>
Nov 03 16:23:23 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:23:23 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:23:23 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:23:23 user nova-compute[74932]:       <nova:owner>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:user uuid="d86959c9099144e2855ce994e8e76f6b">tempest-AttachSCSIVolumeTestJSON-739319920-project-member</nova:user>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:project uuid="7bf23fb278af4fa78737e5d2e20b00a8">tempest-AttachSCSIVolumeTestJSON-739319920</nova:project>
Nov 03 16:23:23 user nova-compute[74932]:       </nova:owner>
Nov 03 16:23:23 user nova-compute[74932]:       <nova:root type="image" uuid="5f5bea02-2093-495f-a621-678ee64918b5"/>
Nov 03 16:23:23 user nova-compute[74932]:       <nova:ports>
Nov 03 16:23:23 user nova-compute[74932]:         <nova:port uuid="20ff3adf-2e43-4a1b-af96-adfb112f335b">
Nov 03 16:23:23 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:23:23 user nova-compute[74932]:         </nova:port>
Nov 03 16:23:23 user nova-compute[74932]:       </nova:ports>
Nov 03 16:23:23 user nova-compute[74932]:     </nova:instance>
Nov 03 16:23:23 user nova-compute[74932]:   </metadata>
Nov 03 16:23:23 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:23:23 user nova-compute[74932]:     <system>
Nov 03 16:23:23 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:23:23 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:23:23 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:23:23 user nova-compute[74932]:       <entry name="serial">1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff</entry>
Nov 03 16:23:23 user nova-compute[74932]:       <entry name="uuid">1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff</entry>
Nov 03 16:23:23 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:23:23 user nova-compute[74932]:     </system>
Nov 03 16:23:23 user nova-compute[74932]:   </sysinfo>
Nov 03 16:23:23 user nova-compute[74932]:   <os>
Nov 03 16:23:23 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:23:23 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:23:23 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:23:23 user nova-compute[74932]:   </os>
Nov 03 16:23:23 user nova-compute[74932]:   <features>
Nov 03 16:23:23 user nova-compute[74932]:     <acpi/>
Nov 03 16:23:23 user nova-compute[74932]:     <apic/>
Nov 03 16:23:23 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:23:23 user nova-compute[74932]:   </features>
Nov 03 16:23:23 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:23:23 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:23:23 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:23:23 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:23:23 user nova-compute[74932]:   </clock>
Nov 03 16:23:23 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:23:23 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:23:23 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:23:23 user nova-compute[74932]:   </cpu>
Nov 03 16:23:23 user nova-compute[74932]:   <devices>
Nov 03 16:23:23 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:23:23 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:23:23 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk"/>
Nov 03 16:23:23 user nova-compute[74932]:       <target dev="sda" bus="scsi"/>
Nov 03 16:23:23 user nova-compute[74932]:       <address type="drive" controller="0" unit="0"/>
Nov 03 16:23:23 user nova-compute[74932]:     </disk>
Nov 03 16:23:23 user nova-compute[74932]:     <disk type="file" device="cdrom">
Nov 03 16:23:23 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 16:23:23 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.config"/>
Nov 03 16:23:23 user nova-compute[74932]:       <target dev="sdb" bus="scsi"/>
Nov 03 16:23:23 user nova-compute[74932]:       <address type="drive" controller="0" unit="1"/>
Nov 03 16:23:23 user nova-compute[74932]:     </disk>
Nov 03 16:23:23 user nova-compute[74932]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 03 16:23:23 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:23:23 user nova-compute[74932]:       <mac address="fa:16:3e:89:86:42"/>
Nov 03 16:23:23 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:23 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:23:23 user nova-compute[74932]:       <target dev="tap20ff3adf-2e"/>
Nov 03 16:23:23 user nova-compute[74932]:     </interface>
Nov 03 16:23:23 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:23:23 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/console.log" append="off"/>
Nov 03 16:23:23 user nova-compute[74932]:     </serial>
Nov 03 16:23:23 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:23:23 user nova-compute[74932]:     <video>
Nov 03 16:23:23 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:23 user nova-compute[74932]:     </video>
Nov 03 16:23:23 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:23:23 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:23:23 user nova-compute[74932]:     </rng>
Nov 03 16:23:23 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:23:23 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:23:23 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:23:23 user nova-compute[74932]:     </memballoon>
Nov 03 16:23:23 user nova-compute[74932]:   </devices>
Nov 03 16:23:23 user nova-compute[74932]: </domain>
Nov 03 16:23:23 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1419577564',display_name='tempest-AttachSCSIVolumeTestJSON-server-1419577564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1419577564',id=5,image_ref='5f5bea02-2093-495f-a621-678ee64918b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5ul8HM0L2dn2OQV8NeqtHUeIokr5gWbPVndmcGu3ussKu41aM6YSKRSWhuY5+B/XhrqWCYg59tXGv8fAi1mv8/ceMkdpSbf5IfGKtNFFlWmAgrrDMFNIWMhmdghfQGOQ==',key_name='tempest-keypair-68860100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bf23fb278af4fa78737e5d2e20b00a8',ramdisk_id='',reservation_id='r-nym64i9r',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f5bea02-2093-495f-a621-678ee64918b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-739319920',owner_user_name='tempest-AttachSCSIVolumeTestJSON-739319920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d86959c9099144e2855ce994e8e76f6b',uuid=1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Converting VIF {"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG os_vif [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e8973dc-1c4b-5eea-898f-4241c4ca78c5', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20ff3adf-2e, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20ff3adf-2e, col_values=(('qos', UUID('3fb394e4-91f9-4de5-a270-734cd7ba67d7')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20ff3adf-2e, col_values=(('external_ids', {'iface-id': '20ff3adf-2e43-4a1b-af96-adfb112f335b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:86:42', 'vm-uuid': '1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:23 user nova-compute[74932]: INFO os_vif [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e')
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No BDM found with device name sda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No VIF found with MAC fa:16:3e:89:86:42, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:23:23 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Using config drive
Nov 03 16:23:23 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Creating config drive at /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.config
Nov 03 16:23:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe5r23ghp {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe5r23ghp" returned: 0 in 0.054s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:23 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Instance spawned successfully.
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:23 user nova-compute[74932]: INFO nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-changed-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Refreshing instance network info cache due to event network-changed-20ff3adf-2e43-4a1b-af96-adfb112f335b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] Acquiring lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] Acquired lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:23 user nova-compute[74932]: DEBUG nova.network.neutron [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Refreshing network info cache for port 20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:23:24 user nova-compute[74932]: INFO nova.compute.manager [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Took 8.87 seconds to build instance.
Nov 03 16:23:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-666b7537-a5f5-48dd-9677-817aae107c31 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.083s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG nova.network.neutron [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updated VIF entry in instance network info cache for port 20ff3adf-2e43-4a1b-af96-adfb112f335b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG nova.network.neutron [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updating instance_info_cache with network_info: [{"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9e9a69a2-49a8-40fc-bf39-a7d8e5f411b6 req-0c315099-b8fd-4f5d-bbda-99a91dd558ce service nova] Releasing lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2cff0fb-8930-44be-8ee9-0f5fbb358413 req-1a1bd80e-2af1-4aed-9e8e-3b1a0c128276 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2cff0fb-8930-44be-8ee9-0f5fbb358413 req-1a1bd80e-2af1-4aed-9e8e-3b1a0c128276 service nova] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2cff0fb-8930-44be-8ee9-0f5fbb358413 req-1a1bd80e-2af1-4aed-9e8e-3b1a0c128276 service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2cff0fb-8930-44be-8ee9-0f5fbb358413 req-1a1bd80e-2af1-4aed-9e8e-3b1a0c128276 service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2cff0fb-8930-44be-8ee9-0f5fbb358413 req-1a1bd80e-2af1-4aed-9e8e-3b1a0c128276 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] No waiting events found dispatching network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:24 user nova-compute[74932]: WARNING nova.compute.manager [req-f2cff0fb-8930-44be-8ee9-0f5fbb358413 req-1a1bd80e-2af1-4aed-9e8e-3b1a0c128276 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received unexpected event network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 for instance with vm_state building and task_state spawning.
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] No waiting events found dispatching network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:27 user nova-compute[74932]: WARNING nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received unexpected event network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 for instance with vm_state building and task_state spawning.
Nov 03 16:23:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] No waiting events found dispatching network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:27 user nova-compute[74932]: WARNING nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received unexpected event network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b for instance with vm_state building and task_state spawning.
Nov 03 16:23:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] No waiting events found dispatching network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:27 user nova-compute[74932]: WARNING nova.compute.manager [req-a64b1fd5-e27d-4b20-a69c-9aff944d9210 req-76dd9855-590a-4f67-b171-c8217a1c6bdf service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received unexpected event network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b for instance with vm_state building and task_state spawning.
Nov 03 16:23:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: be942262-61f1-452b-bda1-5185b321477b] Instance spawned successfully.
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Instance spawned successfully.
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:28 user nova-compute[74932]: INFO nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Took 9.32 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:28 user nova-compute[74932]: INFO nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Took 10.85 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:28 user nova-compute[74932]: INFO nova.compute.manager [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Took 11.44 seconds to build instance.
Nov 03 16:23:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-67cee3bc-cbad-4513-8510-3213ce15e46f tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.645s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:28 user nova-compute[74932]: INFO nova.compute.manager [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Took 12.07 seconds to build instance.
Nov 03 16:23:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6619d361-66dc-4685-a73d-117b3bb32062 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.270s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:23:31 user nova-compute[74932]: INFO nova.compute.claims [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Claim successful on node user
Nov 03 16:23:31 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:23:31 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:23:32 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:23:32 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Creating image(s)
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "/opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "/opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "/opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG nova.policy [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e0b38596a4d402a9a37f538a09d8a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7ccab8ee8544a1b87bbad60ed45c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.240s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.268s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk 1073741824" returned: 0 in 0.061s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.277s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Successfully created port: ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Cannot resize image /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Ensure instance console log exists: /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-a32c604a-b82f-4c28-8b52-832e15a8abf9 req-a004cd6d-ce70-4060-9b42-730faefcffe9 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a32c604a-b82f-4c28-8b52-832e15a8abf9 req-a004cd6d-ce70-4060-9b42-730faefcffe9 service nova] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a32c604a-b82f-4c28-8b52-832e15a8abf9 req-a004cd6d-ce70-4060-9b42-730faefcffe9 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a32c604a-b82f-4c28-8b52-832e15a8abf9 req-a004cd6d-ce70-4060-9b42-730faefcffe9 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-a32c604a-b82f-4c28-8b52-832e15a8abf9 req-a004cd6d-ce70-4060-9b42-730faefcffe9 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] No waiting events found dispatching network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:34 user nova-compute[74932]: WARNING nova.compute.manager [req-a32c604a-b82f-4c28-8b52-832e15a8abf9 req-a004cd6d-ce70-4060-9b42-730faefcffe9 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received unexpected event network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 for instance with vm_state active and task_state None.
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Successfully updated port: ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquired lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-changed-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Refreshing instance network info cache due to event network-changed-ca947369-6fd5-4679-a73a-898d1acfe51b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] Acquiring lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updating instance_info_cache with network_info: [{"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Releasing lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Instance network_info: |[{"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] Acquired lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.neutron [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Refreshing network info cache for port ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Start _get_guest_xml network_info=[{"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:23:34 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:34 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-721678955',display_name='tempest-VolumesAssistedSnapshotsTest-server-721678955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-721678955',id=7,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPGouILNPg3HS48sqNWiThMQ2pVUbNF5RAOLP2OlgLRsIop+mcIxVd9xINy5dXBty+9mWHLmE0mc2mTbcBd1kCPKamNBJrwQjK+uQ22q1hQDvA6GRpFKeDY2xY54oOv7g==',key_name='tempest-keypair-1947782587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a7ccab8ee8544a1b87bbad60ed45c59',ramdisk_id='',reservation_id='r-haue4wvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-773436340',owner_user_name='tempest-VolumesAssistedSnapshotsTest-773436340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e0b38596a4d402a9a37f538a09d8a5e',uuid=a354117d-a49b-4b2a-be16-8a5ca0b473b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Converting VIF {"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lazy-loading 'pci_devices' on Instance uuid a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:23:34 user nova-compute[74932]:   <uuid>a354117d-a49b-4b2a-be16-8a5ca0b473b3</uuid>
Nov 03 16:23:34 user nova-compute[74932]:   <name>instance-00000007</name>
Nov 03 16:23:34 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:23:34 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:23:34 user nova-compute[74932]:   <metadata>
Nov 03 16:23:34 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:23:34 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:23:34 user nova-compute[74932]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-721678955</nova:name>
Nov 03 16:23:34 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:23:34</nova:creationTime>
Nov 03 16:23:34 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:23:34 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:23:34 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:23:34 user nova-compute[74932]:       <nova:owner>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:user uuid="6e0b38596a4d402a9a37f538a09d8a5e">tempest-VolumesAssistedSnapshotsTest-773436340-project-member</nova:user>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:project uuid="6a7ccab8ee8544a1b87bbad60ed45c59">tempest-VolumesAssistedSnapshotsTest-773436340</nova:project>
Nov 03 16:23:34 user nova-compute[74932]:       </nova:owner>
Nov 03 16:23:34 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:23:34 user nova-compute[74932]:       <nova:ports>
Nov 03 16:23:34 user nova-compute[74932]:         <nova:port uuid="ca947369-6fd5-4679-a73a-898d1acfe51b">
Nov 03 16:23:34 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:23:34 user nova-compute[74932]:         </nova:port>
Nov 03 16:23:34 user nova-compute[74932]:       </nova:ports>
Nov 03 16:23:34 user nova-compute[74932]:     </nova:instance>
Nov 03 16:23:34 user nova-compute[74932]:   </metadata>
Nov 03 16:23:34 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:23:34 user nova-compute[74932]:     <system>
Nov 03 16:23:34 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:23:34 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:23:34 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:23:34 user nova-compute[74932]:       <entry name="serial">a354117d-a49b-4b2a-be16-8a5ca0b473b3</entry>
Nov 03 16:23:34 user nova-compute[74932]:       <entry name="uuid">a354117d-a49b-4b2a-be16-8a5ca0b473b3</entry>
Nov 03 16:23:34 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:23:34 user nova-compute[74932]:     </system>
Nov 03 16:23:34 user nova-compute[74932]:   </sysinfo>
Nov 03 16:23:34 user nova-compute[74932]:   <os>
Nov 03 16:23:34 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:23:34 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:23:34 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:23:34 user nova-compute[74932]:   </os>
Nov 03 16:23:34 user nova-compute[74932]:   <features>
Nov 03 16:23:34 user nova-compute[74932]:     <acpi/>
Nov 03 16:23:34 user nova-compute[74932]:     <apic/>
Nov 03 16:23:34 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:23:34 user nova-compute[74932]:   </features>
Nov 03 16:23:34 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:23:34 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:23:34 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:23:34 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:23:34 user nova-compute[74932]:   </clock>
Nov 03 16:23:34 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:23:34 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:23:34 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:23:34 user nova-compute[74932]:   </cpu>
Nov 03 16:23:34 user nova-compute[74932]:   <devices>
Nov 03 16:23:34 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:23:34 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:23:34 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk"/>
Nov 03 16:23:34 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:23:34 user nova-compute[74932]:     </disk>
Nov 03 16:23:34 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:23:34 user nova-compute[74932]:       <mac address="fa:16:3e:7f:07:b3"/>
Nov 03 16:23:34 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:34 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:23:34 user nova-compute[74932]:       <target dev="tapca947369-6f"/>
Nov 03 16:23:34 user nova-compute[74932]:     </interface>
Nov 03 16:23:34 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:23:34 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/console.log" append="off"/>
Nov 03 16:23:34 user nova-compute[74932]:     </serial>
Nov 03 16:23:34 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:23:34 user nova-compute[74932]:     <video>
Nov 03 16:23:34 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:23:34 user nova-compute[74932]:     </video>
Nov 03 16:23:34 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:23:34 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:23:34 user nova-compute[74932]:     </rng>
Nov 03 16:23:34 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:23:34 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:23:34 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:23:34 user nova-compute[74932]:     </memballoon>
Nov 03 16:23:34 user nova-compute[74932]:   </devices>
Nov 03 16:23:34 user nova-compute[74932]: </domain>
Nov 03 16:23:34 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-721678955',display_name='tempest-VolumesAssistedSnapshotsTest-server-721678955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-721678955',id=7,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPGouILNPg3HS48sqNWiThMQ2pVUbNF5RAOLP2OlgLRsIop+mcIxVd9xINy5dXBty+9mWHLmE0mc2mTbcBd1kCPKamNBJrwQjK+uQ22q1hQDvA6GRpFKeDY2xY54oOv7g==',key_name='tempest-keypair-1947782587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a7ccab8ee8544a1b87bbad60ed45c59',ramdisk_id='',reservation_id='r-haue4wvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-773436340',owner_user_name='tempest-VolumesAssistedSnapshotsTest-773436340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e0b38596a4d402a9a37f538a09d8a5e',uuid=a354117d-a49b-4b2a-be16-8a5ca0b473b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Converting VIF {"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG os_vif [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61cb231b-27fe-59b5-853c-392dc14e4984', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca947369-6f, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca947369-6f, col_values=(('qos', UUID('bfa2dfe3-481c-4240-9d0c-27df6a7e1d6e')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca947369-6f, col_values=(('external_ids', {'iface-id': 'ca947369-6fd5-4679-a73a-898d1acfe51b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:07:b3', 'vm-uuid': 'a354117d-a49b-4b2a-be16-8a5ca0b473b3'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:34 user nova-compute[74932]: INFO os_vif [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f')
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:23:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] No VIF found with MAC fa:16:3e:7f:07:b3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG nova.network.neutron [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updated VIF entry in instance network info cache for port ca947369-6fd5-4679-a73a-898d1acfe51b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG nova.network.neutron [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updating instance_info_cache with network_info: [{"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d4c8e6bd-cd85-4466-b90f-7619879fb1ee req-ff953558-2a27-4550-a442-be64e318f564 service nova] Releasing lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:23:35 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] No waiting events found dispatching network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:36 user nova-compute[74932]: WARNING nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received unexpected event network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 for instance with vm_state active and task_state None.
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.012s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:36 user nova-compute[74932]: WARNING nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state active and task_state None.
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:36 user nova-compute[74932]: WARNING nova.compute.manager [req-e4799961-a67b-4b86-8edb-7b0ecf818c1d req-be1b5135-0e1a-487f-ba57-8b2ec5843f79 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state active and task_state None.
Nov 03 16:23:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-20b6a798-ab75-44a8-83c9-687dec0c8048 req-b261730f-3efe-4172-b307-cf32f00d27e2 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-20b6a798-ab75-44a8-83c9-687dec0c8048 req-b261730f-3efe-4172-b307-cf32f00d27e2 service nova] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-20b6a798-ab75-44a8-83c9-687dec0c8048 req-b261730f-3efe-4172-b307-cf32f00d27e2 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-20b6a798-ab75-44a8-83c9-687dec0c8048 req-b261730f-3efe-4172-b307-cf32f00d27e2 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-20b6a798-ab75-44a8-83c9-687dec0c8048 req-b261730f-3efe-4172-b307-cf32f00d27e2 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] No waiting events found dispatching network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:36 user nova-compute[74932]: WARNING nova.compute.manager [req-20b6a798-ab75-44a8-83c9-687dec0c8048 req-b261730f-3efe-4172-b307-cf32f00d27e2 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received unexpected event network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b for instance with vm_state building and task_state spawning.
Nov 03 16:23:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Skipping network cache update for instance because it is Building. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:23:37 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid d94f2ba8-e23e-497c-aa29-b282d9bd79e9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:23:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5c0b672-7df2-4fef-b228-900483f1b7b3 req-0b31f6f8-7ec9-4759-85a7-29db63b8ccd8 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5c0b672-7df2-4fef-b228-900483f1b7b3 req-0b31f6f8-7ec9-4759-85a7-29db63b8ccd8 service nova] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5c0b672-7df2-4fef-b228-900483f1b7b3 req-0b31f6f8-7ec9-4759-85a7-29db63b8ccd8 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5c0b672-7df2-4fef-b228-900483f1b7b3 req-0b31f6f8-7ec9-4759-85a7-29db63b8ccd8 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5c0b672-7df2-4fef-b228-900483f1b7b3 req-0b31f6f8-7ec9-4759-85a7-29db63b8ccd8 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] No waiting events found dispatching network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:38 user nova-compute[74932]: WARNING nova.compute.manager [req-b5c0b672-7df2-4fef-b228-900483f1b7b3 req-0b31f6f8-7ec9-4759-85a7-29db63b8ccd8 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received unexpected event network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b for instance with vm_state building and task_state spawning.
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updating instance_info_cache with network_info: [{"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:23:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Instance spawned successfully.
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:23:39 user nova-compute[74932]: INFO nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:23:39 user nova-compute[74932]: INFO nova.compute.manager [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Took 8.04 seconds to build instance.
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3150a06d-ff22-45ec-a4b1-1128f0a40159 tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.218s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:23:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:23:44 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:44 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.644634246826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance be942262-61f1-452b-bda1-5185b321477b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:23:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.114s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-70e24b4e-011b-4991-80d2-5bf3c5a39832 req-08a5e5d1-88d7-46a9-844a-ee0d79df77df service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-70e24b4e-011b-4991-80d2-5bf3c5a39832 req-08a5e5d1-88d7-46a9-844a-ee0d79df77df service nova] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-70e24b4e-011b-4991-80d2-5bf3c5a39832 req-08a5e5d1-88d7-46a9-844a-ee0d79df77df service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-70e24b4e-011b-4991-80d2-5bf3c5a39832 req-08a5e5d1-88d7-46a9-844a-ee0d79df77df service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-70e24b4e-011b-4991-80d2-5bf3c5a39832 req-08a5e5d1-88d7-46a9-844a-ee0d79df77df service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] No waiting events found dispatching network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:45 user nova-compute[74932]: WARNING nova.compute.manager [req-70e24b4e-011b-4991-80d2-5bf3c5a39832 req-08a5e5d1-88d7-46a9-844a-ee0d79df77df service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received unexpected event network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b for instance with vm_state active and task_state None.
Nov 03 16:23:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:23:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:23:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-2298ceab-f773-493f-b525-d6a684b8e967 req-973b0506-93ad-4834-aa4a-e8cb3464c505 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:23:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2298ceab-f773-493f-b525-d6a684b8e967 req-973b0506-93ad-4834-aa4a-e8cb3464c505 service nova] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2298ceab-f773-493f-b525-d6a684b8e967 req-973b0506-93ad-4834-aa4a-e8cb3464c505 service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2298ceab-f773-493f-b525-d6a684b8e967 req-973b0506-93ad-4834-aa4a-e8cb3464c505 service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:23:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-2298ceab-f773-493f-b525-d6a684b8e967 req-973b0506-93ad-4834-aa4a-e8cb3464c505 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] No waiting events found dispatching network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:23:47 user nova-compute[74932]: WARNING nova.compute.manager [req-2298ceab-f773-493f-b525-d6a684b8e967 req-973b0506-93ad-4834-aa4a-e8cb3464c505 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received unexpected event network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b for instance with vm_state active and task_state None.
Nov 03 16:23:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:23:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:23:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:23:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:24:00 user nova-compute[74932]: INFO nova.compute.claims [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Claim successful on node user
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:24:00 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.policy [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba5285c331f4fe2a170ed8623aed9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637cbdeb134a457cb9652bf70048083a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:24:00 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Creating image(s)
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk 1073741824" returned: 0 in 0.052s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Successfully created port: 9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Cannot resize image /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Ensure instance console log exists: /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Successfully updated port: 9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquired lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-changed-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Refreshing instance network info cache due to event network-changed-9ca44a20-177b-4dd1-9d6c-f752f5127ca3. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:24:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] Acquiring lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Releasing lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Instance network_info: |[{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] Acquired lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.neutron [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Refreshing network info cache for port 9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Start _get_guest_xml network_info=[{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:24:02 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:02 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'pci_devices' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:24:02 user nova-compute[74932]:   <uuid>318067b8-c589-4008-b154-5220a87e598e</uuid>
Nov 03 16:24:02 user nova-compute[74932]:   <name>instance-00000008</name>
Nov 03 16:24:02 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:24:02 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:24:02 user nova-compute[74932]:   <metadata>
Nov 03 16:24:02 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:24:02 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:24:02 user nova-compute[74932]:       <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:24:02 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:24:02</nova:creationTime>
Nov 03 16:24:02 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:24:02 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:24:02 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:24:02 user nova-compute[74932]:       <nova:owner>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:24:02 user nova-compute[74932]:       </nova:owner>
Nov 03 16:24:02 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:24:02 user nova-compute[74932]:       <nova:ports>
Nov 03 16:24:02 user nova-compute[74932]:         <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:24:02 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:24:02 user nova-compute[74932]:         </nova:port>
Nov 03 16:24:02 user nova-compute[74932]:       </nova:ports>
Nov 03 16:24:02 user nova-compute[74932]:     </nova:instance>
Nov 03 16:24:02 user nova-compute[74932]:   </metadata>
Nov 03 16:24:02 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:24:02 user nova-compute[74932]:     <system>
Nov 03 16:24:02 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:24:02 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:24:02 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:24:02 user nova-compute[74932]:       <entry name="serial">318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:24:02 user nova-compute[74932]:       <entry name="uuid">318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:24:02 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:24:02 user nova-compute[74932]:     </system>
Nov 03 16:24:02 user nova-compute[74932]:   </sysinfo>
Nov 03 16:24:02 user nova-compute[74932]:   <os>
Nov 03 16:24:02 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:24:02 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:24:02 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:24:02 user nova-compute[74932]:   </os>
Nov 03 16:24:02 user nova-compute[74932]:   <features>
Nov 03 16:24:02 user nova-compute[74932]:     <acpi/>
Nov 03 16:24:02 user nova-compute[74932]:     <apic/>
Nov 03 16:24:02 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:24:02 user nova-compute[74932]:   </features>
Nov 03 16:24:02 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:24:02 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:24:02 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:24:02 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:24:02 user nova-compute[74932]:   </clock>
Nov 03 16:24:02 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:24:02 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:24:02 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:24:02 user nova-compute[74932]:   </cpu>
Nov 03 16:24:02 user nova-compute[74932]:   <devices>
Nov 03 16:24:02 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:24:02 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:24:02 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk"/>
Nov 03 16:24:02 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:24:02 user nova-compute[74932]:     </disk>
Nov 03 16:24:02 user nova-compute[74932]:     <disk type="file" device="cdrom">
Nov 03 16:24:02 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 16:24:02 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config"/>
Nov 03 16:24:02 user nova-compute[74932]:       <target dev="hda" bus="ide"/>
Nov 03 16:24:02 user nova-compute[74932]:     </disk>
Nov 03 16:24:02 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:24:02 user nova-compute[74932]:       <mac address="fa:16:3e:f8:5a:db"/>
Nov 03 16:24:02 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:24:02 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:24:02 user nova-compute[74932]:       <target dev="tap9ca44a20-17"/>
Nov 03 16:24:02 user nova-compute[74932]:     </interface>
Nov 03 16:24:02 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:24:02 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log" append="off"/>
Nov 03 16:24:02 user nova-compute[74932]:     </serial>
Nov 03 16:24:02 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:24:02 user nova-compute[74932]:     <video>
Nov 03 16:24:02 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:24:02 user nova-compute[74932]:     </video>
Nov 03 16:24:02 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:24:02 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:24:02 user nova-compute[74932]:     </rng>
Nov 03 16:24:02 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:24:02 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:24:02 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:24:02 user nova-compute[74932]:     </memballoon>
Nov 03 16:24:02 user nova-compute[74932]:   </devices>
Nov 03 16:24:02 user nova-compute[74932]: </domain>
Nov 03 16:24:02 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG os_vif [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '257904d5-8142-58f9-8a21-ad4b6a37f545', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ca44a20-17, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ca44a20-17, col_values=(('qos', UUID('8550fd68-191f-4767-839c-86476ae3073e')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ca44a20-17, col_values=(('external_ids', {'iface-id': '9ca44a20-177b-4dd1-9d6c-f752f5127ca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:5a:db', 'vm-uuid': '318067b8-c589-4008-b154-5220a87e598e'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:02 user nova-compute[74932]: INFO os_vif [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17')
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No BDM found with device name hda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No VIF found with MAC fa:16:3e:f8:5a:db, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:24:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Using config drive
Nov 03 16:24:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Creating config drive at /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config
Nov 03 16:24:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp46h4bwlq {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp46h4bwlq" returned: 0 in 0.053s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.neutron [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updated VIF entry in instance network info cache for port 9ca44a20-177b-4dd1-9d6c-f752f5127ca3. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG nova.network.neutron [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fbde7259-c190-4590-86b6-46abb69dcb71 req-2068f302-7867-4806-a94c-6717d72921a1 service nova] Releasing lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-ce94af4b-f421-4d09-8a2c-1e0b8e82d40e req-7d9f53bc-ade3-46a5-ac55-e30cb72edd63 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ce94af4b-f421-4d09-8a2c-1e0b8e82d40e req-7d9f53bc-ade3-46a5-ac55-e30cb72edd63 service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ce94af4b-f421-4d09-8a2c-1e0b8e82d40e req-7d9f53bc-ade3-46a5-ac55-e30cb72edd63 service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ce94af4b-f421-4d09-8a2c-1e0b8e82d40e req-7d9f53bc-ade3-46a5-ac55-e30cb72edd63 service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-ce94af4b-f421-4d09-8a2c-1e0b8e82d40e req-7d9f53bc-ade3-46a5-ac55-e30cb72edd63 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:04 user nova-compute[74932]: WARNING nova.compute.manager [req-ce94af4b-f421-4d09-8a2c-1e0b8e82d40e req-7d9f53bc-ade3-46a5-ac55-e30cb72edd63 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 for instance with vm_state building and task_state spawning.
Nov 03 16:24:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-c5440e41-d3f6-4e19-89ef-8085d45bc39d req-3d812069-3734-4c47-b67b-c77081b38bdc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5440e41-d3f6-4e19-89ef-8085d45bc39d req-3d812069-3734-4c47-b67b-c77081b38bdc service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5440e41-d3f6-4e19-89ef-8085d45bc39d req-3d812069-3734-4c47-b67b-c77081b38bdc service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5440e41-d3f6-4e19-89ef-8085d45bc39d req-3d812069-3734-4c47-b67b-c77081b38bdc service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-c5440e41-d3f6-4e19-89ef-8085d45bc39d req-3d812069-3734-4c47-b67b-c77081b38bdc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:06 user nova-compute[74932]: WARNING nova.compute.manager [req-c5440e41-d3f6-4e19-89ef-8085d45bc39d req-3d812069-3734-4c47-b67b-c77081b38bdc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 for instance with vm_state building and task_state spawning.
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:24:06 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 318067b8-c589-4008-b154-5220a87e598e] Instance spawned successfully.
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:06 user nova-compute[74932]: INFO nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 03 16:24:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:24:06 user nova-compute[74932]: INFO nova.compute.manager [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Took 6.73 seconds to build instance.
Nov 03 16:24:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c194832d-eedf-41be-9f35-929f08c43c3f tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.824s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:24:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:24:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:24:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:24:28 user nova-compute[74932]: INFO nova.compute.claims [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Claim successful on node user
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:24:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:24:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:24:28 user nova-compute[74932]: INFO nova.virt.block_device [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Booting with volume cf741834-ac61-45fe-aeb4-a9251302df16 at /dev/vda
Nov 03 16:24:28 user nova-compute[74932]: DEBUG os_brick.utils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:24:28 user nova-compute[74932]: INFO oslo.privsep.daemon [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp39zmmbas/privsep.sock']
Nov 03 16:24:28 user sudo[85948]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp39zmmbas/privsep.sock
Nov 03 16:24:28 user sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 16:24:29 user nova-compute[74932]: DEBUG nova.policy [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc63611e05044d5f9f3abfec22d64fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e884e8ac4b047bea339b595cafc9866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:24:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:30 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Successfully created port: 8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:24:31 user sudo[85948]: pam_unix(sudo:session): session closed for user root
Nov 03 16:24:31 user nova-compute[74932]: INFO oslo.privsep.daemon [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Spawned new privsep daemon via rootwrap
Nov 03 16:24:31 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 16:24:31 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 16:24:31 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 03 16:24:31 user nova-compute[74932]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85951
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e939d28-1726-4135-a19a-62db5b9c3a08]: (2,) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cbbbf8-6f3d-46ca-874b-27af783cc430]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:31 user nova-compute[74932]: WARNING os_brick.initiator.connectors.nvmeof [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8f2cc-3183-46c5-bd09-2a798f0768e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfac44d-58e6-4792-9c12-5fbf93b3ed01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3f7b1a-e55e-4df5-a5d7-08493ddb0408]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Successfully updated port: 8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.compute.manager [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-changed-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.compute.manager [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Refreshing instance network info cache due to event network-changed-8ba1a967-902e-48f5-b5df-96b0fef4b8fd. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] Acquiring lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] Acquired lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.network.neutron [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Refreshing network info cache for port 8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:24:31 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d3bde4-634c-4916-9f0c-d4e71cb20e1d]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] <== get_connector_properties: return (2633ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updating existing volume attachment record: 3afaf4d6-b4fc-49e2-8d57-30f8c9475c64 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.network.neutron [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.network.neutron [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-267e7008-0647-40fe-a385-888c92d5a5bc req-22a51fef-8be5-4228-b52d-21dab44fdfd5 service nova] Releasing lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquired lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:31 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:24:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:24:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updating instance_info_cache with network_info: [{"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Releasing lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance network_info: |[{"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:24:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:24:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:24:40 user nova-compute[74932]: INFO nova.compute.claims [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Claim successful on node user
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:24:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:24:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:24:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Creating image(s)
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "/opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "/opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.policy [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4bb8e6d69e4480983150ec4cd23a270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0b7a96b7504dd786bb63ee5504b40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk 1073741824" returned: 0 in 0.047s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Cannot resize image /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Ensure instance console log exists: /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing instance network info cache due to event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Successfully created port: dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updated VIF entry in instance network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ef66bc31-b880-48e2-8a17-29e1231e97a6 req-f677e2fc-47ea-4d91-8903-1576266afd07 service nova] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Successfully updated port: dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "refresh_cache-4a397eda-4c56-4a53-8aee-2158f9bad2f5" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquired lock "refresh_cache-4a397eda-4c56-4a53-8aee-2158f9bad2f5" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Updating instance_info_cache with network_info: [{"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Releasing lock "refresh_cache-4a397eda-4c56-4a53-8aee-2158f9bad2f5" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Instance network_info: |[{"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Start _get_guest_xml network_info=[{"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:24:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1530474607',display_name='tempest-ServersNegativeTestJSON-server-1530474607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1530474607',id=10,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a0b7a96b7504dd786bb63ee5504b40d',ramdisk_id='',reservation_id='r-lnwkk91f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1609048425',owner_user_name='tempest-ServersNegativeTestJSON-1609048425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:24:41Z,user_data=None,user_id='c4bb8e6d69e4480983150ec4cd23a270',uuid=4a397eda-4c56-4a53-8aee-2158f9bad2f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converting VIF {"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a397eda-4c56-4a53-8aee-2158f9bad2f5 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-changed-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Refreshing instance network info cache due to event network-changed-dd4bd921-5395-43ae-927f-090aa8fc0087. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] Acquiring lock "refresh_cache-4a397eda-4c56-4a53-8aee-2158f9bad2f5" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] Acquired lock "refresh_cache-4a397eda-4c56-4a53-8aee-2158f9bad2f5" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.network.neutron [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Refreshing network info cache for port dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:24:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:24:43 user nova-compute[74932]:   <uuid>4a397eda-4c56-4a53-8aee-2158f9bad2f5</uuid>
Nov 03 16:24:43 user nova-compute[74932]:   <name>instance-0000000a</name>
Nov 03 16:24:43 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:24:43 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:24:43 user nova-compute[74932]:   <metadata>
Nov 03 16:24:43 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:24:43 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:24:43 user nova-compute[74932]:       <nova:name>tempest-ServersNegativeTestJSON-server-1530474607</nova:name>
Nov 03 16:24:43 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:24:43</nova:creationTime>
Nov 03 16:24:43 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:24:43 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:24:43 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:24:43 user nova-compute[74932]:       <nova:owner>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:user uuid="c4bb8e6d69e4480983150ec4cd23a270">tempest-ServersNegativeTestJSON-1609048425-project-member</nova:user>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:project uuid="9a0b7a96b7504dd786bb63ee5504b40d">tempest-ServersNegativeTestJSON-1609048425</nova:project>
Nov 03 16:24:43 user nova-compute[74932]:       </nova:owner>
Nov 03 16:24:43 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:24:43 user nova-compute[74932]:       <nova:ports>
Nov 03 16:24:43 user nova-compute[74932]:         <nova:port uuid="dd4bd921-5395-43ae-927f-090aa8fc0087">
Nov 03 16:24:43 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:24:43 user nova-compute[74932]:         </nova:port>
Nov 03 16:24:43 user nova-compute[74932]:       </nova:ports>
Nov 03 16:24:43 user nova-compute[74932]:     </nova:instance>
Nov 03 16:24:43 user nova-compute[74932]:   </metadata>
Nov 03 16:24:43 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:24:43 user nova-compute[74932]:     <system>
Nov 03 16:24:43 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:24:43 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:24:43 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:24:43 user nova-compute[74932]:       <entry name="serial">4a397eda-4c56-4a53-8aee-2158f9bad2f5</entry>
Nov 03 16:24:43 user nova-compute[74932]:       <entry name="uuid">4a397eda-4c56-4a53-8aee-2158f9bad2f5</entry>
Nov 03 16:24:43 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:24:43 user nova-compute[74932]:     </system>
Nov 03 16:24:43 user nova-compute[74932]:   </sysinfo>
Nov 03 16:24:43 user nova-compute[74932]:   <os>
Nov 03 16:24:43 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:24:43 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:24:43 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:24:43 user nova-compute[74932]:   </os>
Nov 03 16:24:43 user nova-compute[74932]:   <features>
Nov 03 16:24:43 user nova-compute[74932]:     <acpi/>
Nov 03 16:24:43 user nova-compute[74932]:     <apic/>
Nov 03 16:24:43 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:24:43 user nova-compute[74932]:   </features>
Nov 03 16:24:43 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:24:43 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:24:43 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:24:43 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:24:43 user nova-compute[74932]:   </clock>
Nov 03 16:24:43 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:24:43 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:24:43 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:24:43 user nova-compute[74932]:   </cpu>
Nov 03 16:24:43 user nova-compute[74932]:   <devices>
Nov 03 16:24:43 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:24:43 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:24:43 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk"/>
Nov 03 16:24:43 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:24:43 user nova-compute[74932]:     </disk>
Nov 03 16:24:43 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:24:43 user nova-compute[74932]:       <mac address="fa:16:3e:d7:f2:4e"/>
Nov 03 16:24:43 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:24:43 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:24:43 user nova-compute[74932]:       <target dev="tapdd4bd921-53"/>
Nov 03 16:24:43 user nova-compute[74932]:     </interface>
Nov 03 16:24:43 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:24:43 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/console.log" append="off"/>
Nov 03 16:24:43 user nova-compute[74932]:     </serial>
Nov 03 16:24:43 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:24:43 user nova-compute[74932]:     <video>
Nov 03 16:24:43 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:24:43 user nova-compute[74932]:     </video>
Nov 03 16:24:43 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:24:43 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:24:43 user nova-compute[74932]:     </rng>
Nov 03 16:24:43 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:24:43 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:24:43 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:24:43 user nova-compute[74932]:     </memballoon>
Nov 03 16:24:43 user nova-compute[74932]:   </devices>
Nov 03 16:24:43 user nova-compute[74932]: </domain>
Nov 03 16:24:43 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1530474607',display_name='tempest-ServersNegativeTestJSON-server-1530474607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1530474607',id=10,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a0b7a96b7504dd786bb63ee5504b40d',ramdisk_id='',reservation_id='r-lnwkk91f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1609048425',owner_user_name='tempest-ServersNegativeTestJSON-1609048425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:24:41Z,user_data=None,user_id='c4bb8e6d69e4480983150ec4cd23a270',uuid=4a397eda-4c56-4a53-8aee-2158f9bad2f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converting VIF {"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG os_vif [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '568097e9-4f19-5810-a0e6-f9764c397b0e', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd4bd921-53, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd4bd921-53, col_values=(('qos', UUID('01667602-10ad-48cb-963a-03d03a92ae97')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd4bd921-53, col_values=(('external_ids', {'iface-id': 'dd4bd921-5395-43ae-927f-090aa8fc0087', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:f2:4e', 'vm-uuid': '4a397eda-4c56-4a53-8aee-2158f9bad2f5'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:44 user nova-compute[74932]: INFO os_vif [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53')
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] No VIF found with MAC fa:16:3e:d7:f2:4e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Updated VIF entry in instance network info cache for port dd4bd921-5395-43ae-927f-090aa8fc0087. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Updating instance_info_cache with network_info: [{"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-05438154-b242-4f4c-b72b-65c986f20d41 req-a8270f89-0ced-4e46-91b9-da52976987ea service nova] Releasing lock "refresh_cache-4a397eda-4c56-4a53-8aee-2158f9bad2f5" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-changed-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Refreshing instance network info cache due to event network-changed-7ab56479-82d0-433f-a971-d25a3edff1ed. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:24:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Refreshing network info cache for port 7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:24:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-2c8c9851-9219-46b3-8942-54848cd0da4a req-2851c349-ed8b-46b4-9069-6946c9ec246a service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2c8c9851-9219-46b3-8942-54848cd0da4a req-2851c349-ed8b-46b4-9069-6946c9ec246a service nova] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2c8c9851-9219-46b3-8942-54848cd0da4a req-2851c349-ed8b-46b4-9069-6946c9ec246a service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2c8c9851-9219-46b3-8942-54848cd0da4a req-2851c349-ed8b-46b4-9069-6946c9ec246a service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-2c8c9851-9219-46b3-8942-54848cd0da4a req-2851c349-ed8b-46b4-9069-6946c9ec246a service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] No waiting events found dispatching network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:47 user nova-compute[74932]: WARNING nova.compute.manager [req-2c8c9851-9219-46b3-8942-54848cd0da4a req-2851c349-ed8b-46b4-9069-6946c9ec246a service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received unexpected event network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 for instance with vm_state building and task_state spawning.
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:24:47 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:47 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7479MB free_disk=25.511329650878906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Instance spawned successfully.
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:48 user nova-compute[74932]: INFO nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1b0bd55-9e40-42f1-bc5b-a8328b94a16a req-0bd7444e-d874-46f9-8684-7a98df2a6bee service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1b0bd55-9e40-42f1-bc5b-a8328b94a16a req-0bd7444e-d874-46f9-8684-7a98df2a6bee service nova] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1b0bd55-9e40-42f1-bc5b-a8328b94a16a req-0bd7444e-d874-46f9-8684-7a98df2a6bee service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1b0bd55-9e40-42f1-bc5b-a8328b94a16a req-0bd7444e-d874-46f9-8684-7a98df2a6bee service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1b0bd55-9e40-42f1-bc5b-a8328b94a16a req-0bd7444e-d874-46f9-8684-7a98df2a6bee service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] No waiting events found dispatching network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:48 user nova-compute[74932]: WARNING nova.compute.manager [req-b1b0bd55-9e40-42f1-bc5b-a8328b94a16a req-0bd7444e-d874-46f9-8684-7a98df2a6bee service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received unexpected event network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 for instance with vm_state building and task_state spawning.
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance be942262-61f1-452b-bda1-5185b321477b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 318067b8-c589-4008-b154-5220a87e598e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4a397eda-4c56-4a53-8aee-2158f9bad2f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:24:48 user nova-compute[74932]: INFO nova.compute.manager [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Took 7.98 seconds to build instance.
Nov 03 16:24:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e4ca7f9c-7b9a-44c1-ba70-cc1aa137f47a tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.103s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.network.neutron [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updated VIF entry in instance network info cache for port 7ab56479-82d0-433f-a971-d25a3edff1ed. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.network.neutron [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0b55498d-aafe-4e20-9f2b-bbda15dc06d0 req-1628b577-05a4-46fa-b1ea-8eb030bef4ed service nova] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:24:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:49 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:24:52 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Creating image(s)
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Ensure instance console log exists: /opt/stack/data/nova/instances/391f8ba7-9f07-474e-b606-1abb8c9b3dee/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Start _get_guest_xml network_info=[{"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFuSHkgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '391f8ba7-9f07-474e-b606-1abb8c9b3dee', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf741834-ac61-45fe-aeb4-a9251302df16', 'serial': 'cf741834-ac61-45fe-aeb4-a9251302df16'}, 'attachment_id': '3afaf4d6-b4fc-49e2-8d57-30f8c9475c64', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:24:52 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:52 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.005s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connector [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Factory for ISCSI on None {{(pid=74932) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.011s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFuSHkgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:24:52 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:24:52 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:24:52 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae1a1a-8c91-47ba-bb71-ae8830664202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:24:52 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b46ac1-2594-4de4-9496-95db77429981]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16] added
Nov 03 16:24:52 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[72304d8b-95f5-4227-901f-754e38831f68]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0461d97f-f760-4e3d-90f4-67a65334dd19]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFuSHkgf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFuSHkgf" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf8db71-dafc-4450-9e7f-01eca77627e7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFuSHkgf'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f80b43-7120-4a42-97b0-bb681d686a7b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f412be5-8528-476e-8508-62a320beb8ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:24:52 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:24:52 user nova-compute[74932]:  {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:24:52 user nova-compute[74932]: WARNING os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 16:24:52 user nova-compute[74932]: 
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec0ff7f-4f8c-427f-b7eb-af2737bea862]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260]
Nov 03 16:24:52 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260] successful.
Nov 03 16:24:52 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4d61ef-4104-47f3-bf8c-712a9fd2a49a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3088beec-e04a-4730-82bc-0b0a4924563a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:24:52 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:24:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb4eb8a-ebf3-43eb-8a4e-2904ac19c290]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:24:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFuSHkgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23263663431613637', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263663431613637', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-935812280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-935812280',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwiX0Eer8boPtkeg21Q3WVjGPrtuRI87BvCPwg/zTo9q9fQ6IznvXpyEk/YqgUUcVrL1cdDE+llEXNeaiBRClyHO4gLj84yQoWRaEl9cwuUIeZOc9/GqxqlMqa4hJoIcg==',key_name='tempest-keypair-2026465143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e884e8ac4b047bea339b595cafc9866',ramdisk_id='',reservation_id='r-zru35iyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2099233701',owner_user_name='tempest-ServerActionsV293TestJSON-2099233701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc63611e05044d5f9f3abfec22d64fb4',uuid=391f8ba7-9f07-474e-b606-1abb8c9b3dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converting VIF {"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lazy-loading 'pci_devices' on Instance uuid 391f8ba7-9f07-474e-b606-1abb8c9b3dee {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:24:54 user nova-compute[74932]:   <uuid>391f8ba7-9f07-474e-b606-1abb8c9b3dee</uuid>
Nov 03 16:24:54 user nova-compute[74932]:   <name>instance-00000009</name>
Nov 03 16:24:54 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:24:54 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:24:54 user nova-compute[74932]:   <metadata>
Nov 03 16:24:54 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:24:54 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:24:54 user nova-compute[74932]:       <nova:name>tempest-ServerActionsV293TestJSON-server-935812280</nova:name>
Nov 03 16:24:54 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:24:52</nova:creationTime>
Nov 03 16:24:54 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:24:54 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:24:54 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:24:54 user nova-compute[74932]:       <nova:owner>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:user uuid="dc63611e05044d5f9f3abfec22d64fb4">tempest-ServerActionsV293TestJSON-2099233701-project-member</nova:user>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:project uuid="7e884e8ac4b047bea339b595cafc9866">tempest-ServerActionsV293TestJSON-2099233701</nova:project>
Nov 03 16:24:54 user nova-compute[74932]:       </nova:owner>
Nov 03 16:24:54 user nova-compute[74932]:       <nova:ports>
Nov 03 16:24:54 user nova-compute[74932]:         <nova:port uuid="8ba1a967-902e-48f5-b5df-96b0fef4b8fd">
Nov 03 16:24:54 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 16:24:54 user nova-compute[74932]:         </nova:port>
Nov 03 16:24:54 user nova-compute[74932]:       </nova:ports>
Nov 03 16:24:54 user nova-compute[74932]:     </nova:instance>
Nov 03 16:24:54 user nova-compute[74932]:   </metadata>
Nov 03 16:24:54 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:24:54 user nova-compute[74932]:     <system>
Nov 03 16:24:54 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:24:54 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:24:54 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:24:54 user nova-compute[74932]:       <entry name="serial">391f8ba7-9f07-474e-b606-1abb8c9b3dee</entry>
Nov 03 16:24:54 user nova-compute[74932]:       <entry name="uuid">391f8ba7-9f07-474e-b606-1abb8c9b3dee</entry>
Nov 03 16:24:54 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:24:54 user nova-compute[74932]:     </system>
Nov 03 16:24:54 user nova-compute[74932]:   </sysinfo>
Nov 03 16:24:54 user nova-compute[74932]:   <os>
Nov 03 16:24:54 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:24:54 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:24:54 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:24:54 user nova-compute[74932]:   </os>
Nov 03 16:24:54 user nova-compute[74932]:   <features>
Nov 03 16:24:54 user nova-compute[74932]:     <acpi/>
Nov 03 16:24:54 user nova-compute[74932]:     <apic/>
Nov 03 16:24:54 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:24:54 user nova-compute[74932]:   </features>
Nov 03 16:24:54 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:24:54 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:24:54 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:24:54 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:24:54 user nova-compute[74932]:   </clock>
Nov 03 16:24:54 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:24:54 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:24:54 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:24:54 user nova-compute[74932]:   </cpu>
Nov 03 16:24:54 user nova-compute[74932]:   <devices>
Nov 03 16:24:54 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:24:54 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:24:54 user nova-compute[74932]:       <source dev="/dev/sdb"/>
Nov 03 16:24:54 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:24:54 user nova-compute[74932]:       <serial>cf741834-ac61-45fe-aeb4-a9251302df16</serial>
Nov 03 16:24:54 user nova-compute[74932]:     </disk>
Nov 03 16:24:54 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:24:54 user nova-compute[74932]:       <mac address="fa:16:3e:5e:d8:71"/>
Nov 03 16:24:54 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:24:54 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:24:54 user nova-compute[74932]:       <target dev="tap8ba1a967-90"/>
Nov 03 16:24:54 user nova-compute[74932]:     </interface>
Nov 03 16:24:54 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:24:54 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/391f8ba7-9f07-474e-b606-1abb8c9b3dee/console.log" append="off"/>
Nov 03 16:24:54 user nova-compute[74932]:     </serial>
Nov 03 16:24:54 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:24:54 user nova-compute[74932]:     <video>
Nov 03 16:24:54 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:24:54 user nova-compute[74932]:     </video>
Nov 03 16:24:54 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:24:54 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:24:54 user nova-compute[74932]:     </rng>
Nov 03 16:24:54 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:24:54 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:24:54 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:24:54 user nova-compute[74932]:     </memballoon>
Nov 03 16:24:54 user nova-compute[74932]:   </devices>
Nov 03 16:24:54 user nova-compute[74932]: </domain>
Nov 03 16:24:54 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-935812280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-935812280',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwiX0Eer8boPtkeg21Q3WVjGPrtuRI87BvCPwg/zTo9q9fQ6IznvXpyEk/YqgUUcVrL1cdDE+llEXNeaiBRClyHO4gLj84yQoWRaEl9cwuUIeZOc9/GqxqlMqa4hJoIcg==',key_name='tempest-keypair-2026465143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e884e8ac4b047bea339b595cafc9866',ramdisk_id='',reservation_id='r-zru35iyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2099233701',owner_user_name='tempest-ServerActionsV293TestJSON-2099233701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc63611e05044d5f9f3abfec22d64fb4',uuid=391f8ba7-9f07-474e-b606-1abb8c9b3dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converting VIF {"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG os_vif [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e6143d8-c19d-5bc7-a956-f5cceb6ae2f2', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ba1a967-90, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ba1a967-90, col_values=(('qos', UUID('937d5553-5790-4e85-a0aa-cf22e52e69fe')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ba1a967-90, col_values=(('external_ids', {'iface-id': '8ba1a967-902e-48f5-b5df-96b0fef4b8fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d8:71', 'vm-uuid': '391f8ba7-9f07-474e-b606-1abb8c9b3dee'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:54 user nova-compute[74932]: INFO os_vif [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90')
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:24:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] No VIF found with MAC fa:16:3e:5e:d8:71, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG nova.compute.manager [req-9ac86320-00e8-4ac4-a0cd-6050ce0cccb8 req-87f581f4-3595-45c9-b6d1-d86e1b60a6cf service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9ac86320-00e8-4ac4-a0cd-6050ce0cccb8 req-87f581f4-3595-45c9-b6d1-d86e1b60a6cf service nova] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9ac86320-00e8-4ac4-a0cd-6050ce0cccb8 req-87f581f4-3595-45c9-b6d1-d86e1b60a6cf service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9ac86320-00e8-4ac4-a0cd-6050ce0cccb8 req-87f581f4-3595-45c9-b6d1-d86e1b60a6cf service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:55 user nova-compute[74932]: DEBUG nova.compute.manager [req-9ac86320-00e8-4ac4-a0cd-6050ce0cccb8 req-87f581f4-3595-45c9-b6d1-d86e1b60a6cf service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] No waiting events found dispatching network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:55 user nova-compute[74932]: WARNING nova.compute.manager [req-9ac86320-00e8-4ac4-a0cd-6050ce0cccb8 req-87f581f4-3595-45c9-b6d1-d86e1b60a6cf service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received unexpected event network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd for instance with vm_state building and task_state spawning.
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:56 user nova-compute[74932]: INFO nova.compute.manager [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Shelving
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-a48a03bf-f605-453f-aa7b-465d7deca074 req-09f52412-13d0-4692-b8fc-a9be3356bd71 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-unplugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a48a03bf-f605-453f-aa7b-465d7deca074 req-09f52412-13d0-4692-b8fc-a9be3356bd71 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a48a03bf-f605-453f-aa7b-465d7deca074 req-09f52412-13d0-4692-b8fc-a9be3356bd71 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a48a03bf-f605-453f-aa7b-465d7deca074 req-09f52412-13d0-4692-b8fc-a9be3356bd71 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-a48a03bf-f605-453f-aa7b-465d7deca074 req-09f52412-13d0-4692-b8fc-a9be3356bd71 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-unplugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:57 user nova-compute[74932]: WARNING nova.compute.manager [req-a48a03bf-f605-453f-aa7b-465d7deca074 req-09f52412-13d0-4692-b8fc-a9be3356bd71 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-unplugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state active and task_state shelving.
Nov 03 16:24:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:57 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance destroyed successfully.
Nov 03 16:24:57 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Beginning cold snapshot process
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk /opt/stack/data/nova/instances/snapshots/tmp17_erimo/e4ccf52d7e7e4043ac5b81817c3e1f49 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:24:57 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance spawned successfully.
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-70bf15c8-8f90-42f6-ba16-120652266859 req-32d6dac1-cec4-4364-b944-472e2915cd41 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-70bf15c8-8f90-42f6-ba16-120652266859 req-32d6dac1-cec4-4364-b944-472e2915cd41 service nova] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-70bf15c8-8f90-42f6-ba16-120652266859 req-32d6dac1-cec4-4364-b944-472e2915cd41 service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-70bf15c8-8f90-42f6-ba16-120652266859 req-32d6dac1-cec4-4364-b944-472e2915cd41 service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-70bf15c8-8f90-42f6-ba16-120652266859 req-32d6dac1-cec4-4364-b944-472e2915cd41 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] No waiting events found dispatching network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:57 user nova-compute[74932]: WARNING nova.compute.manager [req-70bf15c8-8f90-42f6-ba16-120652266859 req-32d6dac1-cec4-4364-b944-472e2915cd41 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received unexpected event network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd for instance with vm_state building and task_state spawning.
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:24:58 user nova-compute[74932]: INFO nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 03 16:24:58 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:24:58 user nova-compute[74932]: INFO nova.compute.manager [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Took 30.02 seconds to build instance.
Nov 03 16:24:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7282a20b-e67f-415b-803b-9c26a0f82a05 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.142s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk /opt/stack/data/nova/instances/snapshots/tmp17_erimo/e4ccf52d7e7e4043ac5b81817c3e1f49" returned: 0 in 0.900s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:24:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Snapshot extracted, beginning image upload
Nov 03 16:24:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:24:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-ebe66bb4-9a3e-4747-8e58-6fd99c4be965 req-2c8b1983-3093-4534-a0cc-2a2cae05557c service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:24:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ebe66bb4-9a3e-4747-8e58-6fd99c4be965 req-2c8b1983-3093-4534-a0cc-2a2cae05557c service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:24:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ebe66bb4-9a3e-4747-8e58-6fd99c4be965 req-2c8b1983-3093-4534-a0cc-2a2cae05557c service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:24:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ebe66bb4-9a3e-4747-8e58-6fd99c4be965 req-2c8b1983-3093-4534-a0cc-2a2cae05557c service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:24:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-ebe66bb4-9a3e-4747-8e58-6fd99c4be965 req-2c8b1983-3093-4534-a0cc-2a2cae05557c service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:24:59 user nova-compute[74932]: WARNING nova.compute.manager [req-ebe66bb4-9a3e-4747-8e58-6fd99c4be965 req-2c8b1983-3093-4534-a0cc-2a2cae05557c service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 16:25:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:25:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:25:01 user nova-compute[74932]: INFO nova.compute.claims [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Claim successful on node user
Nov 03 16:25:01 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:25:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:25:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Snapshot image upload complete
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:25:02 user nova-compute[74932]: INFO nova.compute.manager [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Shelve offloading
Nov 03 16:25:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:25:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance destroyed successfully.
Nov 03 16:25:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.policy [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc9effb60d8447f199761e316876ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73625a0f392447c80d434d24b8218eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:25:02 user nova-compute[74932]: INFO nova.virt.block_device [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Booting with volume 35980f7b-8727-4640-b188-99ed55d44a60 at /dev/vda
Nov 03 16:25:02 user nova-compute[74932]: DEBUG os_brick.utils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[703fec45-c122-4864-83b6-78df99427d40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd948fb5-68f2-4c37-8114-b82b9ae07933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f990692-b2af-4877-84af-20a5a5b075e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba642aa-5a16-4e33-b721-5c265b360817]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:02 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed7170-87b0-41a6-9edb-607faab4f3a3]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG os_brick.utils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:02 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating existing volume attachment record: 98b3d99d-0253-4b3d-a80e-8f30cff21e4a {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Successfully created port: 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance destroyed successfully.
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'resources' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1869007814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1869007814',id=2,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmRIEWkvnhfWBt9oMf696eo2xeNdm00BGflZzefY/+obY9+I9ANGBdmGwFI0a77BskqR999jg/4fFbW++fyYLZHccvBY8rwrABCqJwA+E9VxffX4qIlgdv/EMbjlWBkqQ==',key_name='tempest-keypair-271065144',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-me8mqfb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member',shelved_at='2023-11-03T16:25:02.071975',shelved_host='user',shelved_image_id='dda83f43-ba9e-4f18-ad55-d343e16fee5b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=0238b778-b9e2-4a5b-82f2-5d58a6a552e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG os_vif [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d0caef5-f0, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing instance network info cache due to event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.network.neutron [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e41f14c-4107-4430-b46f-0e9b1e09898d) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:25:04 user nova-compute[74932]: INFO os_vif [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0')
Nov 03 16:25:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Deleting instance files /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7_del
Nov 03 16:25:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Deletion of /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7_del complete
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74932) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 03 16:25:04 user nova-compute[74932]: INFO nova.virt.libvirt.host [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] UEFI support detected
Nov 03 16:25:04 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Deleted allocations for instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7
Nov 03 16:25:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'numa_topology' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:04 user nova-compute[74932]: DEBUG nova.objects.base [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<0238b778-b9e2-4a5b-82f2-5d58a6a552e7> lazy-loaded attributes: resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7ebd0dd5-0b62-4cd0-93cb-acd2c1a41b6c tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.530s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG nova.network.neutron [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Successfully updated port: 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:05 user nova-compute[74932]: DEBUG nova.network.neutron [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.network.neutron [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updated VIF entry in instance network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.network.neutron [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-20720254-9aa4-4963-a387-e013d083fcd5 req-29de494b-6ef8-4c56-8612-170949818cc8 service nova] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance network_info: |[{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing instance network info cache due to event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:06 user nova-compute[74932]: DEBUG nova.network.neutron [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updated VIF entry in instance network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7ec9de51-5520-42b0-84a6-40f6a3f18fec req-ebafbefd-e7ff-42d4-b152-5bb4b30fc7e4 service nova] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-changed-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Refreshing instance network info cache due to event network-changed-64a184b0-edac-44db-89ce-63db6e13706b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] Acquiring lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] Acquired lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Refreshing network info cache for port 64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-changed-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Refreshing instance network info cache due to event network-changed-dccc0acb-ffa9-4417-bdf3-445b09723240. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] Acquiring lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] Acquired lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Refreshing network info cache for port dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updated VIF entry in instance network info cache for port 64a184b0-edac-44db-89ce-63db6e13706b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updating instance_info_cache with network_info: [{"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fa1cee59-242d-48b4-b67d-544c6939c751 req-0a9113b2-4584-442e-8fc5-c9b762e9ffe4 service nova] Releasing lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lazy-loading 'flavor' on Instance uuid be942262-61f1-452b-bda1-5185b321477b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Updated VIF entry in instance network info cache for port dccc0acb-ffa9-4417-bdf3-445b09723240. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating instance_info_cache with network_info: [{"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-48ecdca0-a483-4032-89de-b4fdcc62b554 req-f6429eb5-0279-4f68-a4f4-909ed08d4c49 service nova] Releasing lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:08 user nova-compute[74932]: INFO nova.compute.manager [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Attaching volume ec374f0e-a93b-4b10-a16e-be5eb59b1637 to /dev/vdb
Nov 03 16:25:08 user nova-compute[74932]: DEBUG os_brick.utils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9527e55c-43f2-46e4-81d3-d1abd4934768]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea790db2-a2ae-4e9c-8e27-b5fc2773f1fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6a5c4d-58a8-4795-a204-6ab00fd87941]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f1ea8c-9f8f-427b-ab32-a9ecdedc1e7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:09 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b115937-3967-4194-a878-dce39b003e08]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG os_brick.utils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating existing volume attachment record: 968facda-0e2f-4bf3-940e-5b4548b49dbb {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-changed-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Refreshing instance network info cache due to event network-changed-20ff3adf-2e43-4a1b-af96-adfb112f335b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] Acquiring lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] Acquired lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:09 user nova-compute[74932]: DEBUG nova.network.neutron [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Refreshing network info cache for port 20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updated VIF entry in instance network info cache for port 20ff3adf-2e43-4a1b-af96-adfb112f335b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updating instance_info_cache with network_info: [{"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2f1685e-7972-49e8-8eda-53c1d15e81b1 req-58442e80-234a-42c2-a493-e889b9298ec9 service nova] Releasing lock "refresh_cache-1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:13 user nova-compute[74932]: DEBUG nova.objects.instance [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'flavor' on Instance uuid 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:13 user nova-compute[74932]: INFO nova.compute.manager [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Attaching volume 8f7b5db2-2529-4464-afbb-4b53cffe889b to /dev/vdb
Nov 03 16:25:14 user nova-compute[74932]: DEBUG os_brick.utils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acca2d7-c274-481c-b8fd-b99295958d24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6bac5b-7ef5-4dc7-b014-bc583193e0bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b018689-0ec7-4c03-8749-8bd8d4446f86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59aa13-2cd7-44fa-b5ff-aa5535b14ed5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:14 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb7feda-7c4c-4a2b-8370-828e71c7ade8]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG os_brick.utils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updating existing volume attachment record: 37bb02c3-5f11-410d-8cee-3c16f11496af {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-changed-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Refreshing instance network info cache due to event network-changed-ca947369-6fd5-4679-a73a-898d1acfe51b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] Acquiring lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] Acquired lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG nova.network.neutron [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Refreshing network info cache for port ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG nova.network.neutron [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updated VIF entry in instance network info cache for port ca947369-6fd5-4679-a73a-898d1acfe51b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG nova.network.neutron [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updating instance_info_cache with network_info: [{"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0cde9a1-1e0b-46c3-a1e1-f9fbe6187e9d req-0f7ad0e8-90c0-49b2-85c3-28977d24953c service nova] Releasing lock "refresh_cache-a354117d-a49b-4b2a-be16-8a5ca0b473b3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNbCknyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:30 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:30 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:30 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[44421e62-0a1e-45b0-84a6-9ef91c7a5f96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:25:30 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[117a31ff-1053-476c-b6de-f76e9d7bfb90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637] added
Nov 03 16:25:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b782ec0-c650-44ed-9435-55271850ec5b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08c514-1315-4d3a-a211-5ce5959a479d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNbCknyA {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNbCknyA" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1249e9b0-c1ab-467f-9907-ecb4ec04ad7b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNbCknyA'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd5d4af-cc05-40b8-bbe7-94b7309f5ee3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a28591e-40c4-4f9c-8add-72cc4dcf8948]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927ce8f-4de1-449d-a536-f6cbebd0d4c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260]
Nov 03 16:25:30 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260] successful.
Nov 03 16:25:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[33820691-f542-4f2c-b693-05ebab7e9b3e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e344e44-45c4-4c89-a2aa-eac8f0e0b4d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:30 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:30 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.041s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[037bf523-7b3d-4210-8693-3d0249908b25]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNbCknyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lazy-loading 'flavor' on Instance uuid a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG nova.objects.instance [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lazy-loading 'flavor' on Instance uuid 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:31 user nova-compute[74932]: INFO nova.compute.manager [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Attaching volume 067e32e8-193b-457c-97bd-222c94deca31 to /dev/vdb
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:31 user nova-compute[74932]: INFO nova.compute.manager [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Attaching volume a028f717-4874-42b1-a409-22dfc247fc6f to /dev/sdc
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d61e3a7-82f5-4189-a00a-6d2b1ef44d38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e276769d-6343-4996-881c-e081059ba7f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7404ed41-04bd-428a-8164-0920693ca2b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[239aed38-b5ea-43bc-8689-519e22ef172a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:31 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3dd1fc-3743-467a-98ed-9f0782cd1d99]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updating existing volume attachment record: 6ba18741-3334-411c-921d-16c4f3bfd7eb {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d3d97-973b-4d05-b31a-6925e12761a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f3c79-427d-41d1-b95d-09db69b1bc85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87efd1-8ba3-4650-bcb9-9d060019371f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d5ed4c-96de-4420-b468-20ce8b78ee0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:31 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e13e71-909e-4a1a-aedc-fe0c19fa862a]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updating existing volume attachment record: 911be168-2162-4f8b-a47a-1972de885f62 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23066613535663165', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066613535663165', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG nova.objects.instance [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lazy-loading 'flavor' on Instance uuid be942262-61f1-452b-bda1-5185b321477b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:25:31 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:31 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:25:31 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:25:31 user nova-compute[74932]:   <serial>ec374f0e-a93b-4b10-a16e-be5eb59b1637</serial>
Nov 03 16:25:31 user nova-compute[74932]: </disk>
Nov 03 16:25:31 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] No VIF found with MAC fa:16:3e:8e:98:92, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:25:32 user nova-compute[74932]: INFO nova.compute.claims [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Claim successful on node user
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:25:33 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:25:33 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:25:33 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:25:33 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:25:33 user nova-compute[74932]: INFO nova.virt.block_device [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Booting with volume b3583d6b-22b6-4d6a-9126-eb15a6febfcc at /dev/vda
Nov 03 16:25:33 user nova-compute[74932]: DEBUG nova.policy [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0014382a16714a6ea8f480165b94d8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d7e1c111a34d35930b25a5357ae5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:25:33 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully created port: f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully created port: a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWYaSpuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:34 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:34 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:34 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully created port: 0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7075e7e-3852-4857-97d8-6bd4984c10e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:25:34 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c593340e-eab0-496d-adca-d7d16eb6b023]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b] added
Nov 03 16:25:34 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2ac3a-8861-410f-ba04-267ff8205c28]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b8e123-9ed9-4c1d-9cf5-b0a62b22a15c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWYaSpuU {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWYaSpuU" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d5cf5-5569-4836-b3a2-19c599cfa718]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWYaSpuU'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[db947ca0-35f3-4363-b59a-d6278a52ae37]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc83c3-dc82-4e29-8ddb-bed9365a362f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb7051-a71e-4b91-b744-e82910eae4bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260]
Nov 03 16:25:35 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260] successful.
Nov 03 16:25:35 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afffd7b-52b7-41bf-bb54-264d650c37d8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e414a1ee-6b2f-4f2e-909f-f2167d2725e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:35 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:35 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:35 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020be1c-6cf6-4181-8a1c-3727076b637c]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWYaSpuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:25:35 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully created port: 348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26163376138393661', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163376138393661', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.objects.instance [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'flavor' on Instance uuid 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:25:36 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:36 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:25:36 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:25:36 user nova-compute[74932]:   <serial>8f7b5db2-2529-4464-afbb-4b53cffe889b</serial>
Nov 03 16:25:36 user nova-compute[74932]: </disk>
Nov 03 16:25:36 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully created port: 61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No VIF found with MAC fa:16:3e:e2:47:8f, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG nova.network.neutron [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:37 user nova-compute[74932]: DEBUG nova.network.neutron [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:38 user nova-compute[74932]: DEBUG nova.network.neutron [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-71a7da60-1b9f-4c06-825d-cb2e313b0399 req-d7d67d0c-0bf1-4eb0-944d-a7487f0c5446 service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:38 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: 2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: 5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-2507f374-275d-4c75-8a34-64a9e36eed8d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port 2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port 5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6990919-49aa-4d72-91bc-1236f7bb4be1 req-34058ef2-6e1a-41b8-acaf-cf411ace499f service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:40 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: 0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: 348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-a20486a5-f54d-4f05-828d-dfbc6b0cb66d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:25:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-22065be1-592b-43b6-b7df-99a793068234 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.211s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-0bfd246d-a03a-4e06-9e68-499e2ce5c73e. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port 0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1b79f22e-d6d5-4cfd-a26e-9a7c774fc87a tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.380s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.utils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-348c7c87-85a8-41e6-a214-6170a5b2d721. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port 348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9768df46-3078-4b6e-8249-ec02e60df32f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:25:42 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Creating image(s)
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Start _get_guest_xml network_info=[{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8e7e5d7-df88-4470-99f7-24f015dcf32a', 'attached_at': '', 'detached_at': '', 'volume_id': '35980f7b-8727-4640-b188-99ed55d44a60', 'serial': '35980f7b-8727-4640-b188-99ed55d44a60'}, 'attachment_id': '98b3d99d-0253-4b3d-a80e-8f30cff21e4a', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78da16bf-4ebe-408a-8a80-e664460dedcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:25:42 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:42 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:42 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:42 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9931125-8c0b-4bc2-8e85-89ccdba0cff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce217205-58b6-41c7-95e6-0db27b01db82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827cb1d-b3a4-4ec3-80ff-2c885ef12eda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:25:42 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Successfully updated port: 61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:42 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e65bd-2e51-4660-a155-85b57bb10f9e]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.utils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating existing volume attachment record: 16384707-2dc2-4d3a-b831-c9beb97cb11b {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac91c96c-e6b5-4eb3-99b8-f95e3fc00a10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60] added
Nov 03 16:25:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e5c4a6-c96e-4b2f-ad26-bcf5d8c87684]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d88d8f8-3d92-4f1e-bc03-ef00c016741f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVhrZsAz {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVhrZsAz" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a565e-0342-4426-b8e7-26884d66109b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVhrZsAz'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c829e6c-4375-4841-a66c-f9f6934dcb41]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca5e32-5663-4f9d-bbad-494a9481b2bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9da24874-79b2-4dd2-930d-d42249e0790f req-5271541f-ef00-4bad-b9ac-d1c08b178130 service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6927fd0-c475-4963-b099-052155eafc13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]
Nov 03 16:25:42 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.
Nov 03 16:25:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e15691-8484-41a4-a4db-f4c09a5a1df9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[116cc12b-07d5-4752-aa75-7f43739e50b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:42 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a79206-ed15-4189-b910-ed602f9bb83c]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-61357ead-7a4e-4809-8640-dbf23410df4f. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '26436623537643865', 'path': '/dev/sde'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436623537643865', 'path': '/dev/sde'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-420698720',display_name='tempest-TestShelveInstance-server-420698720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-420698720',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YVp4QArOry6wW4DcYHofoyY7wX7kwbaHbXSXApJtuRayIg7cKh+m1UEUtqjFWuXK9/WyPenbGoccvFYqPtZfuINOvxqUn+6cwjpHHFISvh2O1UB10GIoD8ddRfbp8tQ==',key_name='tempest-TestShelveInstance-110969466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e73625a0f392447c80d434d24b8218eb',ramdisk_id='',reservation_id='r-tw8lmu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1221651483',owner_user_name='tempest-TestShelveInstance-1221651483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:02Z,user_data=None,user_id='dc9effb60d8447f199761e316876ca81',uuid=d8e7e5d7-df88-4470-99f7-24f015dcf32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converting VIF {"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.objects.instance [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:25:44 user nova-compute[74932]:   <uuid>d8e7e5d7-df88-4470-99f7-24f015dcf32a</uuid>
Nov 03 16:25:44 user nova-compute[74932]:   <name>instance-0000000b</name>
Nov 03 16:25:44 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:25:44 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:25:44 user nova-compute[74932]:   <metadata>
Nov 03 16:25:44 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:25:44 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:25:44 user nova-compute[74932]:       <nova:name>tempest-TestShelveInstance-server-420698720</nova:name>
Nov 03 16:25:44 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:25:42</nova:creationTime>
Nov 03 16:25:44 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:25:44 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:25:44 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:25:44 user nova-compute[74932]:       <nova:owner>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:user uuid="dc9effb60d8447f199761e316876ca81">tempest-TestShelveInstance-1221651483-project-member</nova:user>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:project uuid="e73625a0f392447c80d434d24b8218eb">tempest-TestShelveInstance-1221651483</nova:project>
Nov 03 16:25:44 user nova-compute[74932]:       </nova:owner>
Nov 03 16:25:44 user nova-compute[74932]:       <nova:ports>
Nov 03 16:25:44 user nova-compute[74932]:         <nova:port uuid="102e231c-e02f-4a02-8534-e22a3c48f0e8">
Nov 03 16:25:44 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 16:25:44 user nova-compute[74932]:         </nova:port>
Nov 03 16:25:44 user nova-compute[74932]:       </nova:ports>
Nov 03 16:25:44 user nova-compute[74932]:     </nova:instance>
Nov 03 16:25:44 user nova-compute[74932]:   </metadata>
Nov 03 16:25:44 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:25:44 user nova-compute[74932]:     <system>
Nov 03 16:25:44 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:25:44 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:25:44 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:25:44 user nova-compute[74932]:       <entry name="serial">d8e7e5d7-df88-4470-99f7-24f015dcf32a</entry>
Nov 03 16:25:44 user nova-compute[74932]:       <entry name="uuid">d8e7e5d7-df88-4470-99f7-24f015dcf32a</entry>
Nov 03 16:25:44 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:25:44 user nova-compute[74932]:     </system>
Nov 03 16:25:44 user nova-compute[74932]:   </sysinfo>
Nov 03 16:25:44 user nova-compute[74932]:   <os>
Nov 03 16:25:44 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:25:44 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:25:44 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:25:44 user nova-compute[74932]:   </os>
Nov 03 16:25:44 user nova-compute[74932]:   <features>
Nov 03 16:25:44 user nova-compute[74932]:     <acpi/>
Nov 03 16:25:44 user nova-compute[74932]:     <apic/>
Nov 03 16:25:44 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:25:44 user nova-compute[74932]:   </features>
Nov 03 16:25:44 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:25:44 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:25:44 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:25:44 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:25:44 user nova-compute[74932]:   </clock>
Nov 03 16:25:44 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:25:44 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:25:44 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:25:44 user nova-compute[74932]:   </cpu>
Nov 03 16:25:44 user nova-compute[74932]:   <devices>
Nov 03 16:25:44 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:25:44 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:44 user nova-compute[74932]:       <source dev="/dev/sde"/>
Nov 03 16:25:44 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:25:44 user nova-compute[74932]:       <serial>35980f7b-8727-4640-b188-99ed55d44a60</serial>
Nov 03 16:25:44 user nova-compute[74932]:     </disk>
Nov 03 16:25:44 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:25:44 user nova-compute[74932]:       <mac address="fa:16:3e:35:1b:03"/>
Nov 03 16:25:44 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:25:44 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:25:44 user nova-compute[74932]:       <target dev="tap102e231c-e0"/>
Nov 03 16:25:44 user nova-compute[74932]:     </interface>
Nov 03 16:25:44 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:25:44 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a/console.log" append="off"/>
Nov 03 16:25:44 user nova-compute[74932]:     </serial>
Nov 03 16:25:44 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:25:44 user nova-compute[74932]:     <video>
Nov 03 16:25:44 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:25:44 user nova-compute[74932]:     </video>
Nov 03 16:25:44 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:25:44 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:25:44 user nova-compute[74932]:     </rng>
Nov 03 16:25:44 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:25:44 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:25:44 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:25:44 user nova-compute[74932]:     </memballoon>
Nov 03 16:25:44 user nova-compute[74932]:   </devices>
Nov 03 16:25:44 user nova-compute[74932]: </domain>
Nov 03 16:25:44 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-420698720',display_name='tempest-TestShelveInstance-server-420698720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-420698720',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YVp4QArOry6wW4DcYHofoyY7wX7kwbaHbXSXApJtuRayIg7cKh+m1UEUtqjFWuXK9/WyPenbGoccvFYqPtZfuINOvxqUn+6cwjpHHFISvh2O1UB10GIoD8ddRfbp8tQ==',key_name='tempest-TestShelveInstance-110969466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e73625a0f392447c80d434d24b8218eb',ramdisk_id='',reservation_id='r-tw8lmu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1221651483',owner_user_name='tempest-TestShelveInstance-1221651483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:02Z,user_data=None,user_id='dc9effb60d8447f199761e316876ca81',uuid=d8e7e5d7-df88-4470-99f7-24f015dcf32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converting VIF {"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG os_vif [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea9d1325-ae4d-54fe-91ab-5f14631d1b0b', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap102e231c-e0, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap102e231c-e0, col_values=(('qos', UUID('412a9109-b761-4723-a2b9-63462a8ac66a')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap102e231c-e0, col_values=(('external_ids', {'iface-id': '102e231c-e02f-4a02-8534-e22a3c48f0e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:1b:03', 'vm-uuid': 'd8e7e5d7-df88-4470-99f7-24f015dcf32a'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:44 user nova-compute[74932]: INFO os_vif [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0')
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] No VIF found with MAC fa:16:3e:35:1b:03, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance network_info: |[{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG nova.network.neutron [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port 61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-480ae020-03e4-48de-b6e4-eca88c45fcc7 req-d5de6018-ce11-4ee1-bea4-9a52098b4109 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-480ae020-03e4-48de-b6e4-eca88c45fcc7 req-d5de6018-ce11-4ee1-bea4-9a52098b4109 service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-480ae020-03e4-48de-b6e4-eca88c45fcc7 req-d5de6018-ce11-4ee1-bea4-9a52098b4109 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-480ae020-03e4-48de-b6e4-eca88c45fcc7 req-d5de6018-ce11-4ee1-bea4-9a52098b4109 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-480ae020-03e4-48de-b6e4-eca88c45fcc7 req-d5de6018-ce11-4ee1-bea4-9a52098b4109 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:25:45 user nova-compute[74932]: WARNING nova.compute.manager [req-480ae020-03e4-48de-b6e4-eca88c45fcc7 req-d5de6018-ce11-4ee1-bea4-9a52098b4109 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state building and task_state spawning.
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updated VIF entry in instance network info cache for port 61357ead-7a4e-4809-8640-dbf23410df4f. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cb3bd6e4-17c0-4e3e-855f-7b1cf26c9a88 req-1f97486c-6502-49c5-b7af-5d35a23ef98a service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:25:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7544MB free_disk=25.448726654052734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance be942262-61f1-452b-bda1-5185b321477b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 318067b8-c589-4008-b154-5220a87e598e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4a397eda-4c56-4a53-8aee-2158f9bad2f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d8e7e5d7-df88-4470-99f7-24f015dcf32a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:25:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-05ad7309-791a-4249-a853-6c94a9ed6ada req-21dc3c64-4cb1-40fe-8ba1-a57d6eefeb37 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-05ad7309-791a-4249-a853-6c94a9ed6ada req-21dc3c64-4cb1-40fe-8ba1-a57d6eefeb37 service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-05ad7309-791a-4249-a853-6c94a9ed6ada req-21dc3c64-4cb1-40fe-8ba1-a57d6eefeb37 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-05ad7309-791a-4249-a853-6c94a9ed6ada req-21dc3c64-4cb1-40fe-8ba1-a57d6eefeb37 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-05ad7309-791a-4249-a853-6c94a9ed6ada req-21dc3c64-4cb1-40fe-8ba1-a57d6eefeb37 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:25:47 user nova-compute[74932]: WARNING nova.compute.manager [req-05ad7309-791a-4249-a853-6c94a9ed6ada req-21dc3c64-4cb1-40fe-8ba1-a57d6eefeb37 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state building and task_state spawning.
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:25:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance spawned successfully.
Nov 03 16:25:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:25:48 user nova-compute[74932]: INFO nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 03 16:25:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:25:48 user nova-compute[74932]: INFO nova.compute.manager [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Took 47.06 seconds to build instance.
Nov 03 16:25:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-11951860-d9ff-4894-98f9-321808751a0d tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.224s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-changed-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Refreshing instance network info cache due to event network-changed-9ca44a20-177b-4dd1-9d6c-f752f5127ca3. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] Acquiring lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] Acquired lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:51 user nova-compute[74932]: DEBUG nova.network.neutron [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Refreshing network info cache for port 9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updated VIF entry in instance network info cache for port 9ca44a20-177b-4dd1-9d6c-f752f5127ca3. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "interface-318067b8-c589-4008-b154-5220a87e598e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "interface-318067b8-c589-4008-b154-5220a87e598e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.objects.instance [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'flavor' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f58a461f-4db0-4bd1-a3f5-71b7d65e33b2 req-af304969-5102-4d61-8d74-9896bb561917 service nova] Releasing lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.objects.instance [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'pci_requests' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.objects.base [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Object Instance<318067b8-c589-4008-b154-5220a87e598e> lazy-loaded attributes: flavor,pci_requests {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:25:52 user nova-compute[74932]: DEBUG nova.policy [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba5285c331f4fe2a170ed8623aed9c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637cbdeb134a457cb9652bf70048083a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:25:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Successfully created port: a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Successfully updated port: a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquired lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-changed-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Refreshing instance network info cache due to event network-changed-a4413064-969d-4c4c-8559-48c43de58f8b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] Acquiring lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxnhVUFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:54 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:54 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:54 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5701b7-2d66-4412-9ae2-8ac54d6290eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:25:54 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c26ea-839f-4629-a39a-c8bb911f4792]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31] added
Nov 03 16:25:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6de157d-3490-4a41-a697-6dd6e476e165]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[250ab25b-b570-4926-b6b6-d0837eac8a43]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxnhVUFY {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxnhVUFY" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de30bd-2274-449b-8e1b-9ce0c8d75ce3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CxnhVUFY'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3af78-d504-488d-9472-5fe99db3d8c6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03f918-5040-4574-92c9-c074822f4901]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c52ce-5a16-402a-89bc-98ad3fc1e126]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260]
Nov 03 16:25:54 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260] successful.
Nov 03 16:25:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[56672738-2f5c-4174-86ed-4b166ad443d7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c23530b-a20c-462c-b97e-bd5203f4ef5f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:25:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[695d8e01-649a-4c1c-9036-382a59ee235a]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Releasing lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] Acquired lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.neutron [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Refreshing network info cache for port a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG os_vif [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36522ac4-a660-5b64-bb91-e52318b4e6b4', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4413064-96, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4413064-96, col_values=(('qos', UUID('07b18974-9c16-4b99-82c7-0e1e9594109c')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4413064-96, col_values=(('external_ids', {'iface-id': 'a4413064-969d-4c4c-8559-48c43de58f8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:41:70', 'vm-uuid': '318067b8-c589-4008-b154-5220a87e598e'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:54 user nova-compute[74932]: INFO os_vif [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96')
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:25:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] attach device xml: <interface type="ethernet">
Nov 03 16:25:54 user nova-compute[74932]:   <mac address="fa:16:3e:cf:41:70"/>
Nov 03 16:25:54 user nova-compute[74932]:   <model type="virtio"/>
Nov 03 16:25:54 user nova-compute[74932]:   <mtu size="1442"/>
Nov 03 16:25:54 user nova-compute[74932]:   <target dev="tapa4413064-96"/>
Nov 03 16:25:54 user nova-compute[74932]: </interface>
Nov 03 16:25:54 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No BDM found with device name hda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No VIF found with MAC fa:16:3e:f8:5a:db, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:25:55 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:25:55 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:25:55 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:25:55</nova:creationTime>
Nov 03 16:25:55 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:25:55 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:25:55 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:25:55 user nova-compute[74932]:   <nova:owner>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:25:55 user nova-compute[74932]:   </nova:owner>
Nov 03 16:25:55 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:25:55 user nova-compute[74932]:   <nova:ports>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:25:55 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:25:55 user nova-compute[74932]:     </nova:port>
Nov 03 16:25:55 user nova-compute[74932]:     <nova:port uuid="a4413064-969d-4c4c-8559-48c43de58f8b">
Nov 03 16:25:55 user nova-compute[74932]:       <nova:ip type="fixed" address="10.10.10.249" ipVersion="4"/>
Nov 03 16:25:55 user nova-compute[74932]:     </nova:port>
Nov 03 16:25:55 user nova-compute[74932]:   </nova:ports>
Nov 03 16:25:55 user nova-compute[74932]: </nova:instance>
Nov 03 16:25:55 user nova-compute[74932]:  {{(pid=74932) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1af18937-4541-460b-bd23-3a04ec0d33b4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "interface-318067b8-c589-4008-b154-5220a87e598e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.121s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.utils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.compute.manager [req-0ed75103-a14b-48dc-9c7b-2ab2ac3107f3 req-513a9a38-8ada-45a1-bdec-04fe376bb2aa service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0ed75103-a14b-48dc-9c7b-2ab2ac3107f3 req-513a9a38-8ada-45a1-bdec-04fe376bb2aa service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0ed75103-a14b-48dc-9c7b-2ab2ac3107f3 req-513a9a38-8ada-45a1-bdec-04fe376bb2aa service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0ed75103-a14b-48dc-9c7b-2ab2ac3107f3 req-513a9a38-8ada-45a1-bdec-04fe376bb2aa service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.compute.manager [req-0ed75103-a14b-48dc-9c7b-2ab2ac3107f3 req-513a9a38-8ada-45a1-bdec-04fe376bb2aa service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:25:55 user nova-compute[74932]: WARNING nova.compute.manager [req-0ed75103-a14b-48dc-9c7b-2ab2ac3107f3 req-513a9a38-8ada-45a1-bdec-04fe376bb2aa service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b for instance with vm_state active and task_state None.
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.network.neutron [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updated VIF entry in instance network info cache for port a4413064-969d-4c4c-8559-48c43de58f8b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.network.neutron [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a82ed6-6905-436a-aad8-e65829c0fee7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxnhVUFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23261366135623933', 'path': '/dev/sdf'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366135623933', 'path': '/dev/sdf'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a746873a-a282-4809-a3aa-8eda96f7dd0b req-d5eb42f2-5a06-4140-8f42-dd2f77e99ecc service nova] Releasing lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ab0f1f-4234-47d7-96ed-229651f4eb9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lazy-loading 'flavor' on Instance uuid a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac882ba8-9a10-4f30-ae17-c0d3fe9bd5dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30a569-1177-42f6-880f-a086c8ada0bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] attach device xml: <disk type="block" device="disk">
Nov 03 16:25:55 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:55 user nova-compute[74932]:   <source dev="/dev/sdf"/>
Nov 03 16:25:55 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:25:55 user nova-compute[74932]:   <serial>067e32e8-193b-457c-97bd-222c94deca31</serial>
Nov 03 16:25:55 user nova-compute[74932]: </disk>
Nov 03 16:25:55 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:55 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce12f99-e960-44a5-8da8-a878ff4ff391]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:55 user nova-compute[74932]: DEBUG os_brick.utils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:55 user nova-compute[74932]: INFO nova.compute.manager [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] Swapping volume ec374f0e-a93b-4b10-a16e-be5eb59b1637 for fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:25:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:25:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] No VIF found with MAC fa:16:3e:7f:07:b3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:25:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:25:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-a526062a-63c0-4ec3-8e04-a73c15b58c51 req-76490d9b-ee17-497b-8460-7961299947df service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:25:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a526062a-63c0-4ec3-8e04-a73c15b58c51 req-76490d9b-ee17-497b-8460-7961299947df service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a526062a-63c0-4ec3-8e04-a73c15b58c51 req-76490d9b-ee17-497b-8460-7961299947df service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a526062a-63c0-4ec3-8e04-a73c15b58c51 req-76490d9b-ee17-497b-8460-7961299947df service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-a526062a-63c0-4ec3-8e04-a73c15b58c51 req-76490d9b-ee17-497b-8460-7961299947df service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:25:57 user nova-compute[74932]: WARNING nova.compute.manager [req-a526062a-63c0-4ec3-8e04-a73c15b58c51 req-76490d9b-ee17-497b-8460-7961299947df service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b for instance with vm_state active and task_state None.
Nov 03 16:25:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBNnUXkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:58 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:58 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:25:58 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[729461a6-d319-4de8-ab4a-99e603531c16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:25:58 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1587726b-52bc-474d-805a-9cd3e40f90b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f] added
Nov 03 16:25:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce630529-04ea-4993-a30e-9b63e650b2fb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c793a04d-613f-41e4-8735-39aba4042990]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBNnUXkb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBNnUXkb" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a5460-af6f-452b-b9e4-aabcae8de567]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MBNnUXkb'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG nova.objects.instance [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'flavor' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3998f95d-036b-4c67-9454-732d52b77f04]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:58 user nova-compute[74932]: INFO nova.compute.manager [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Detaching volume 8f7b5db2-2529-4464-afbb-4b53cffe889b
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6ff1b-d1ed-4ff8-a58c-eed8e98442d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e455a26f-3a07-4ba8-b985-f4bc2033569a tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.492s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57ffeeb-2ed7-49d3-ae4c-d7bf48a4a0d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260]
Nov 03 16:25:58 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260] successful.
Nov 03 16:25:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0e653-7c5e-4bc4-a53a-6959436d5310]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9b09df-63c3-4621-833e-3f010c358831]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:25:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:25:58 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:25:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1333ba-05ce-4129-90ae-629501177706]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:58 user nova-compute[74932]: INFO nova.virt.block_device [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Attempting to driver detach volume 8f7b5db2-2529-4464-afbb-4b53cffe889b from mountpoint /dev/vdb
Nov 03 16:25:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Attempting to detach device vdb from instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:25:58 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:58 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:25:58 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:25:58 user nova-compute[74932]:   <serial>8f7b5db2-2529-4464-afbb-4b53cffe889b</serial>
Nov 03 16:25:58 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:25:58 user nova-compute[74932]: </disk>
Nov 03 16:25:58 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:25:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Successfully detached device vdb from instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade from the persistent domain config.
Nov 03 16:25:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:25:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:25:58 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:58 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:25:58 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:25:58 user nova-compute[74932]:   <serial>8f7b5db2-2529-4464-afbb-4b53cffe889b</serial>
Nov 03 16:25:58 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:25:58 user nova-compute[74932]: </disk>
Nov 03 16:25:58 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:25:59 user nova-compute[74932]: INFO nova.compute.manager [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Attaching volume 7f94783d-127a-42b9-86a3-bedde216290e to /dev/vdb
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.utils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] volume_snapshot_create: create_info: {'snapshot_id': 'daf72d04-a87f-4794-9a63-294dc3056fad', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74932) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc604c6-3f78-4a4d-b28d-25a1cfda59e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] snap xml: <domainsnapshot>
Nov 03 16:25:59 user nova-compute[74932]:   <disks>
Nov 03 16:25:59 user nova-compute[74932]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 03 16:25:59 user nova-compute[74932]:       <source file="/dev/new_file"/>
Nov 03 16:25:59 user nova-compute[74932]:     </disk>
Nov 03 16:25:59 user nova-compute[74932]:     <disk name="vda" snapshot="no"/>
Nov 03 16:25:59 user nova-compute[74932]:   </disks>
Nov 03 16:25:59 user nova-compute[74932]: </domainsnapshot>
Nov 03 16:25:59 user nova-compute[74932]:  {{(pid=74932) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] Lazy-loading 'system_metadata' on Instance uuid a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb05f6eb-5607-40a7-87ae-c3a2603621bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a0c5ae-ccca-4138-966e-43638a4281a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8118f9a-f48f-4bba-a41a-456156aea70e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:25:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d9d06603-5a7e-4587-a5ff-7a14b79395f5 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] volume_snapshot_delete: delete_info: {'volume_id': '067e32e8-193b-457c-97bd-222c94deca31'} {{(pid=74932) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [None req-d9d06603-5a7e-4587-a5ff-7a14b79395f5 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     if delete_info['type'] != 'qcow2':
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] KeyError: 'type'
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] 
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:25:59 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:25:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f67ff16-87ff-4a6a-ad58-d9115464d301]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     rv = execute(f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     six.reraise(c, e, tb)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     raise value
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     rv = meth(*args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     self._volume_snapshot_create(context, instance, guest,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     rv = execute(f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     six.reraise(c, e, tb)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     raise value
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     rv = meth(*args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] 
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.utils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating existing volume attachment record: 7e0e7ed8-2675-47e0-99b8-b70e43a1644b {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [None req-d9d06603-5a7e-4587-a5ff-7a14b79395f5 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-bd300db7-e223-4568-831c-01f8e432c2bb)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot daf72d04-a87f-4794-9a63-294dc3056fad could not be found.
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise value
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot daf72d04-a87f-4794-9a63-294dc3056fad could not be found. (HTTP 404) (Request-ID: req-c2ba432c-85a9-4c68-8b6f-8250c1016130)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot daf72d04-a87f-4794-9a63-294dc3056fad could not be found.
Nov 03 16:25:59 user nova-compute[74932]: ERROR nova.virt.libvirt.driver 
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server [None req-d9d06603-5a7e-4587-a5ff-7a14b79395f5 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] Exception during message handling: KeyError: 'type'
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server [None req-5d3d6013-f74e-4248-aaa4-da47079921a1 tempest-VolumesAssistedSnapshotsTest-2121943471 tempest-VolumesAssistedSnapshotsTest-2121943471-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise value
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 16:25:59 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBNnUXkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23663346663316130', 'path': '/dev/sdg'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663346663316130', 'path': '/dev/sdg'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lazy-loading 'flavor' on Instance uuid 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:25:59 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:25:59 user nova-compute[74932]:   <source dev="/dev/sdg"/>
Nov 03 16:25:59 user nova-compute[74932]:   <target dev="sdc" bus="scsi"/>
Nov 03 16:25:59 user nova-compute[74932]:   <serial>a028f717-4874-42b1-a409-22dfc247fc6f</serial>
Nov 03 16:25:59 user nova-compute[74932]:   <address type="drive" controller="0" unit="2"/>
Nov 03 16:25:59 user nova-compute[74932]: </disk>
Nov 03 16:25:59 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:25:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No BDM found with device name sda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:26:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:26:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:26:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] No VIF found with MAC fa:16:3e:89:86:42, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:26:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-57d7113a-110b-44d1-b895-827f21ea3563 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.923s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:06 user nova-compute[74932]: INFO nova.virt.block_device [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Booting with volume 6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 at /dev/vdb
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:06 user nova-compute[74932]: INFO nova.compute.manager [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Detaching volume 067e32e8-193b-457c-97bd-222c94deca31
Nov 03 16:26:06 user nova-compute[74932]: DEBUG os_brick.utils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfddb859-9510-4dd7-896b-18c1d2161f32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[93881b37-7d3e-4064-8c6d-665ddd72d34e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e5d80-352d-4c2e-8ef3-d2ca0049c8a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c028042-0bbd-45e6-b35b-5731638c2e5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:06 user nova-compute[74932]: INFO nova.virt.block_device [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Attempting to driver detach volume 067e32e8-193b-457c-97bd-222c94deca31 from mountpoint /dev/vdb
Nov 03 16:26:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Attempting to detach device vdb from instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 16:26:06 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:06 user nova-compute[74932]:   <source dev="/dev/sdf"/>
Nov 03 16:26:06 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:26:06 user nova-compute[74932]:   <serial>067e32e8-193b-457c-97bd-222c94deca31</serial>
Nov 03 16:26:06 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:26:06 user nova-compute[74932]: </disk>
Nov 03 16:26:06 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:06 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:26:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e40e3-4bd4-451f-94df-5928eb636524]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG os_brick.utils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating existing volume attachment record: fc727624-79a1-4305-9dd9-a9d300af45dd {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:26:06 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Successfully detached device vdb from instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 from the persistent domain config.
Nov 03 16:26:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:26:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 16:26:06 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:06 user nova-compute[74932]:   <source dev="/dev/sdf"/>
Nov 03 16:26:06 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:26:06 user nova-compute[74932]:   <serial>067e32e8-193b-457c-97bd-222c94deca31</serial>
Nov 03 16:26:06 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:26:06 user nova-compute[74932]: </disk>
Nov 03 16:26:06 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:26:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:26:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG nova.compute.manager [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCxUfBcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be942262-61f1-452b-bda1-5185b321477b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa584ebb-400a-4e36-8901-fce6b8cd3179', 'serial': 'fa584ebb-400a-4e36-8901-fce6b8cd3179'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNbCknyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'be942262-61f1-452b-bda1-5185b321477b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec374f0e-a93b-4b10-a16e-be5eb59b1637', 'serial'} {{(pid=74932) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCxUfBcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:18 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:18 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:18 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d9aa8-c91d-4eee-af5e-54891bdae50c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:26:18 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd908ca6-4ed0-4723-aacb-5de54f528255]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179] added
Nov 03 16:26:18 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b609007-b9e9-4fbb-b5d6-57edd7259835]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006c3ad-2f28-405f-8c42-ba72185e3c0a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCxUfBcV {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCxUfBcV" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fbe8e2-4ee9-47b2-8c60-05f4b2262cd7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCxUfBcV'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346e818-f82a-48b9-ac5b-2d0697b41347]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf420cb-8fed-4412-8178-f73fc2e94b2b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:18 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:18 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992c806-65e1-4690-9def-9b555228ad58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260]
Nov 03 16:26:18 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:18 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[42624506-dc57-497e-9d21-56ddd8ed82fe]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e24021-fb13-4a31-82cf-ba1cfb3b0390]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:18 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:18 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78970e8f-0f48-454e-926d-bc2d9eff8826]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:18 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-changed-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Refreshing instance network info cache due to event network-changed-8ba1a967-902e-48f5-b5df-96b0fef4b8fd. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] Acquiring lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] Acquired lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Refreshing network info cache for port 8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:19 user nova-compute[74932]: INFO nova.compute.manager [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Detaching volume a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:19 user nova-compute[74932]: INFO nova.virt.block_device [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Attempting to driver detach volume a028f717-4874-42b1-a409-22dfc247fc6f from mountpoint /dev/sdc
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Attempting to detach device sdc from instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:26:19 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:19 user nova-compute[74932]:   <source dev="/dev/sdg"/>
Nov 03 16:26:19 user nova-compute[74932]:   <target dev="sdc" bus="scsi"/>
Nov 03 16:26:19 user nova-compute[74932]:   <serial>a028f717-4874-42b1-a409-22dfc247fc6f</serial>
Nov 03 16:26:19 user nova-compute[74932]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 16:26:19 user nova-compute[74932]: </disk>
Nov 03 16:26:19 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:26:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Successfully detached device sdc from instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff from the persistent domain config.
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:26:19 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:19 user nova-compute[74932]:   <source dev="/dev/sdg"/>
Nov 03 16:26:19 user nova-compute[74932]:   <target dev="sdc" bus="scsi"/>
Nov 03 16:26:19 user nova-compute[74932]:   <serial>a028f717-4874-42b1-a409-22dfc247fc6f</serial>
Nov 03 16:26:19 user nova-compute[74932]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 16:26:19 user nova-compute[74932]: </disk>
Nov 03 16:26:19 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:26:19 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade is timed out.
Nov 03 16:26:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Successfully detached device vdb from instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade from the live domain config.
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWYaSpuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:19 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updated VIF entry in instance network info cache for port 8ba1a967-902e-48f5-b5df-96b0fef4b8fd. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updating instance_info_cache with network_info: [{"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-732f2dc5-6f60-435c-9b77-8c92c922b384 req-1f718a3f-a07b-4ffc-a7b9-c1dce64d82cc service nova] Releasing lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCxUfBcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26637313936643664', 'path': '/dev/sdh'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637313936643664', 'path': '/dev/sdh'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.464s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG nova.objects.instance [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lazy-loading 'flavor' on Instance uuid be942262-61f1-452b-bda1-5185b321477b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85275d9-eb93-4c2b-bb66-beb6e9046c77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:19 user nova-compute[74932]: No targets found.
Nov 03 16:26:19 user nova-compute[74932]: iSNS:
Nov 03 16:26:19 user nova-compute[74932]: No targets found.
Nov 03 16:26:19 user nova-compute[74932]: STATIC:
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16
Nov 03 16:26:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:19 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:19 user nova-compute[74932]: No targets found.
Nov 03 16:26:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:19 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:19 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dcef27-2a7f-48e5-9f44-f23c22604c06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed109a42-9696-47d2-b4bb-c2a85706cc4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:19 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc846c1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35062cf-7f81-464f-b85a-69f26495bf9b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c393f-525b-4d1d-9969-ac90bc75cfcf]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01618f55-d595-4078-ae67-ec42f6150af6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0fbc75-2f7a-4c81-a0ec-d87be4e5cea1]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c56aad-a77c-4d1b-a11a-6d6a457c9cba]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7845149b-411d-459f-bfce-a68829cb268f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260]
Nov 03 16:26:20 user nova-compute[74932]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7b5db2-2529-4464-afbb-4b53cffe889b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f44729-1921-42da-96e5-43722f479113]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] <== disconnect_volume: return (820ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:20 user nova-compute[74932]: INFO nova.compute.manager [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Rebuilding instance
Nov 03 16:26:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 69206016 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc940d30-241b-4d51-aa88-d7e3528b7e62 req-5326c6df-5ea1-4f4b-97ec-724ddfdbb640 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-vif-unplugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc940d30-241b-4d51-aa88-d7e3528b7e62 req-5326c6df-5ea1-4f4b-97ec-724ddfdbb640 service nova] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc940d30-241b-4d51-aa88-d7e3528b7e62 req-5326c6df-5ea1-4f4b-97ec-724ddfdbb640 service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc940d30-241b-4d51-aa88-d7e3528b7e62 req-5326c6df-5ea1-4f4b-97ec-724ddfdbb640 service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc940d30-241b-4d51-aa88-d7e3528b7e62 req-5326c6df-5ea1-4f4b-97ec-724ddfdbb640 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] No waiting events found dispatching network-vif-unplugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:21 user nova-compute[74932]: WARNING nova.compute.manager [req-bc940d30-241b-4d51-aa88-d7e3528b7e62 req-5326c6df-5ea1-4f4b-97ec-724ddfdbb640 service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received unexpected event network-vif-unplugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd for instance with vm_state active and task_state rebuilding.
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 213909504 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance destroyed successfully.
Nov 03 16:26:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance destroyed successfully.
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-127648816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-935812280',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwiX0Eer8boPtkeg21Q3WVjGPrtuRI87BvCPwg/zTo9q9fQ6IznvXpyEk/YqgUUcVrL1cdDE+llEXNeaiBRClyHO4gLj84yQoWRaEl9cwuUIeZOc9/GqxqlMqa4hJoIcg==',key_name='tempest-keypair-2026465143',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7e884e8ac4b047bea339b595cafc9866',ramdisk_id='',reservation_id='r-zru35iyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2099233701',owner_user_name='tempest-ServerActionsV293TestJSON-2099233701-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc63611e05044d5f9f3abfec22d64fb4',uuid=391f8ba7-9f07-474e-b606-1abb8c9b3dee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converting VIF {"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_vif [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ba1a967-90, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=937d5553-5790-4e85-a0aa-cf22e52e69fe) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:21 user nova-compute[74932]: INFO os_vif [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90')
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFuSHkgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:21 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeb3293-8115-416b-8f86-b94189f790e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:21 user nova-compute[74932]: No targets found.
Nov 03 16:26:21 user nova-compute[74932]: iSNS:
Nov 03 16:26:21 user nova-compute[74932]: No targets found.
Nov 03 16:26:21 user nova-compute[74932]: STATIC:
Nov 03 16:26:21 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:21 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:21 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:21 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:21 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:21 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:21 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:21 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:21 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:21 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31
Nov 03 16:26:21 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:21 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:21 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637
Nov 03 16:26:21 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:21 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:21 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16
Nov 03 16:26:21 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:21 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:21 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:21 user nova-compute[74932]: No targets found.
Nov 03 16:26:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:21 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:21 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f04d214-0c16-4774-8ddf-fb7179f919a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'flavor' on Instance uuid 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5273d56-8e68-4139-9fcd-bfbed45381ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:21 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc843c8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3ac6b13f-769c-4bbf-a42b-4f690da830c5 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.255s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5bcc4d-2dbd-42b2-84f5-13cfdaf1ea96]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[978dc421-ccc8-4683-9b4b-1e066004ca88]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48dc8c4-4a1f-44d1-a425-680a1061384a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec497b-8586-4b47-9acc-7737452d31f8]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO904e6126-2cf41a6704584f5f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_904e6126', '/dev/disk/by-id/scsi-23263663431613637') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 16:26:21 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO904e6126-2cf41a6704584f5f
Nov 03 16:26:21 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_904e6126
Nov 03 16:26:21 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23263663431613637
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[832fc9a5-cf5f-4240-9b9c-99df35b4e64c]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa9761f-09e8-4b60-88bb-f4c499837058]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 313524224 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d58fa-a4d6-4cef-bac1-9af828252ffb]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260]
Nov 03 16:26:21 user nova-compute[74932]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac891fe0-496d-49a2-84d9-477c1130f910]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] <== disconnect_volume: return (424ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Deleting instance files /opt/stack/data/nova/instances/391f8ba7-9f07-474e-b606-1abb8c9b3dee_del
Nov 03 16:26:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Deletion of /opt/stack/data/nova/instances/391f8ba7-9f07-474e-b606-1abb8c9b3dee_del complete
Nov 03 16:26:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANZzQTij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:22 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:22 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:22 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6247a2-c143-4c77-8fa5-89c5968bac51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:26:22 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee9e107-d1bb-487f-a9d7-e8c7695d495b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e] added
Nov 03 16:26:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[20807354-87e6-4128-8371-5edf13bb92fc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7957606-db62-4619-94d2-34e944752d6b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANZzQTij {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANZzQTij" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff12236c-897a-4f2d-a22d-4a883bd394de]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANZzQTij'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee could not be found.
Nov 03 16:26:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFuSHkgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:22 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc695a-74c1-40e7-9fa5-f1f3e6ac230a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[141f73bd-5807-4c50-903d-112c46299219]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 396361728 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[50905eb6-aa17-421c-b986-c766aba9bcd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260]
Nov 03 16:26:22 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68907aa-b6d7-4657-a2da-e445e8b60fef]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[90351377-a148-4913-bc8e-4b53ce8f07d1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:22 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aefbe3-ffd0-4f3e-9e27-69768055c67b]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANZzQTij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:26:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 544210944 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-4b5acc03-af40-44c7-9a80-2c7fca2a7296 req-168fa4d8-9d48-4bad-bd2c-0363cfcbb73c service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4b5acc03-af40-44c7-9a80-2c7fca2a7296 req-168fa4d8-9d48-4bad-bd2c-0363cfcbb73c service nova] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4b5acc03-af40-44c7-9a80-2c7fca2a7296 req-168fa4d8-9d48-4bad-bd2c-0363cfcbb73c service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4b5acc03-af40-44c7-9a80-2c7fca2a7296 req-168fa4d8-9d48-4bad-bd2c-0363cfcbb73c service nova] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-4b5acc03-af40-44c7-9a80-2c7fca2a7296 req-168fa4d8-9d48-4bad-bd2c-0363cfcbb73c service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] No waiting events found dispatching network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:23 user nova-compute[74932]: WARNING nova.compute.manager [req-4b5acc03-af40-44c7-9a80-2c7fca2a7296 req-168fa4d8-9d48-4bad-bd2c-0363cfcbb73c service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received unexpected event network-vif-plugged-8ba1a967-902e-48f5-b5df-96b0fef4b8fd for instance with vm_state active and task_state rebuilding.
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23530383031336135', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530383031336135', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.246s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.objects.instance [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'flavor' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc491f24-7990-45a1-b463-14e276cf48bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:23 user nova-compute[74932]: No targets found.
Nov 03 16:26:23 user nova-compute[74932]: iSNS:
Nov 03 16:26:23 user nova-compute[74932]: No targets found.
Nov 03 16:26:23 user nova-compute[74932]: STATIC:
Nov 03 16:26:23 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:23 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:23 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:23 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:23 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:23 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:23 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:23 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:23 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:23 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31
Nov 03 16:26:23 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:23 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:23 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e
Nov 03 16:26:23 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:23 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:23 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637
Nov 03 16:26:23 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:23 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:23 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:23 user nova-compute[74932]: No targets found.
Nov 03 16:26:23 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:23 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:23 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:26:23 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:23 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:26:23 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:26:23 user nova-compute[74932]:   <serial>7f94783d-127a-42b9-86a3-bedde216290e</serial>
Nov 03 16:26:23 user nova-compute[74932]: </disk>
Nov 03 16:26:23 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d35bb-6dbe-4431-9f58-e2e3e62ab7f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8750710-9a5e-43b7-9839-fac0587f8c9c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:23 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:23 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:23 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64685090>, {}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Disconnecting from: [] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] <== disconnect_volume: return (1342ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 816840704 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:26:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No BDM found with device name hda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:26:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] No VIF found with MAC fa:16:3e:f8:5a:db, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:26:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-843b6707-693c-4ef0-a1ff-4210ef410851 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.273s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 931135488 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Preparing to wait for external event volume-reimaged-cf741834-ac61-45fe-aeb4-a9251302df16 {{(pid=74932) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNbCknyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:25 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6aea65-5157-457c-b380-9aaaa972b199]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:25 user nova-compute[74932]: No targets found.
Nov 03 16:26:25 user nova-compute[74932]: iSNS:
Nov 03 16:26:25 user nova-compute[74932]: No targets found.
Nov 03 16:26:25 user nova-compute[74932]: STATIC:
Nov 03 16:26:25 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:25 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:25 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:25 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:25 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:25 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:25 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:25 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:25 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:25 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31
Nov 03 16:26:25 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:25 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:25 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e
Nov 03 16:26:25 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:25 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:25 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637
Nov 03 16:26:25 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:25 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:25 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:25 user nova-compute[74932]: No targets found.
Nov 03 16:26:25 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:25 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:25 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8496b82c-0e10-472f-8389-c66aaefad873]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4897c9-bf2e-4313-87c1-9408f6bf29f5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:25 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:25 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:25 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645aa0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881bc39-ca6f-43d2-a2b3-aa5813f30318]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc5a8a-fdd5-48cc-9ae6-39cd47901f5c]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95522f71-3fef-4d9c-986c-0beeec81abf8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634d689-696e-4ba5-97b7-26c5732190a9]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa37299-640c-405e-a590-5be9dbd102d1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37f173-d6ac-4311-9131-f1e4f0d0f859]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260]
Nov 03 16:26:25 user nova-compute[74932]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:25 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec374f0e-a93b-4b10-a16e-be5eb59b1637 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5fbd09-2d0c-4f8f-950f-1ba64c01db89]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] <== disconnect_volume: return (359ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.compute.manager [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCxUfBcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'be942262-61f1-452b-bda1-5185b321477b', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa584ebb-400a-4e36-8901-fce6b8cd3179', 'serial'} {{(pid=74932) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.compute.manager [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] swap_volume: removing Cinder connection for volume ec374f0e-a93b-4b10-a16e-be5eb59b1637 {{(pid=74932) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:26 user nova-compute[74932]: INFO nova.compute.manager [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Detaching volume 7f94783d-127a-42b9-86a3-bedde216290e
Nov 03 16:26:26 user nova-compute[74932]: INFO nova.virt.block_device [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Attempting to driver detach volume 7f94783d-127a-42b9-86a3-bedde216290e from mountpoint /dev/vdb
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Attempting to detach device vdb from instance 318067b8-c589-4008-b154-5220a87e598e from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:26:26 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:26 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:26:26 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:26:26 user nova-compute[74932]:   <serial>7f94783d-127a-42b9-86a3-bedde216290e</serial>
Nov 03 16:26:26 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 16:26:26 user nova-compute[74932]: </disk>
Nov 03 16:26:26 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:26:26 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully detached device vdb from instance 318067b8-c589-4008-b154-5220a87e598e from the persistent domain config.
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 318067b8-c589-4008-b154-5220a87e598e from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:26:26 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:26:26 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:26:26 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:26:26 user nova-compute[74932]:   <serial>7f94783d-127a-42b9-86a3-bedde216290e</serial>
Nov 03 16:26:26 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 16:26:26 user nova-compute[74932]: </disk>
Nov 03 16:26:26 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG nova.compute.manager [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] swap_volume: Updating volume ec374f0e-a93b-4b10-a16e-be5eb59b1637 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XCxUfBcV", "auth_password": "Z5bMiXzH9AguJG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "fa584ebb-400a-4e36-8901-fce6b8cd3179"}, "status": "reserved", "instance": "be942262-61f1-452b-bda1-5185b321477b", "attached_at": "", "detached_at": "", "volume_id": "fa584ebb-400a-4e36-8901-fce6b8cd3179", "serial": "fa584ebb-400a-4e36-8901-fce6b8cd3179"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'fa584ebb-400a-4e36-8901-fce6b8cd3179', 'no_device': None, 'attachment_id': 'ea522630-16e9-4714-94e8-56611e4aeb3b'} {{(pid=74932) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-54174e47-f6b7-464a-b6b9-19e8c5f79951 tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.374s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:27 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 is timed out.
Nov 03 16:26:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Successfully detached device vdb from instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 from the live domain config.
Nov 03 16:26:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxnhVUFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:27 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71c2902-139b-40cf-8270-76122f22e061]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:27 user nova-compute[74932]: No targets found.
Nov 03 16:26:27 user nova-compute[74932]: iSNS:
Nov 03 16:26:27 user nova-compute[74932]: No targets found.
Nov 03 16:26:27 user nova-compute[74932]: STATIC:
Nov 03 16:26:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31
Nov 03 16:26:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e
Nov 03 16:26:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:27 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:27 user nova-compute[74932]: No targets found.
Nov 03 16:26:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:27 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:27 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9516eab5-55b9-4af6-b48f-ebf41051f536]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac15bf4-5a4e-4469-b211-0693902028d2]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:27 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc845a6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31'): ({'sdf'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Removing single pathed devices sdf {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2201ed2-3676-4ef1-ab4a-1132e3a279dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9d0aa-f6ee-4654-8659-bf3e5e179908]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Flushing IO for device /dev/sdf {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3e6ec-f14f-42b7-887c-735cac79e046]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b50d3-bada-4792-bae2-027196e445bc]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] SCSI volumes sdf have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ed21c-8305-4fcc-9d9a-ebc46d0b2715]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb04d81-04a2-4319-9265-8a3783b7a429]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260]
Nov 03 16:26:27 user nova-compute[74932]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067e32e8-193b-457c-97bd-222c94deca31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0127d4-1085-4df0-9c0b-445aface42df]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] <== disconnect_volume: return (305ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG os_brick.utils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8cef9-b062-4822-803b-82c4734c3a82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf3d8a-1caa-451f-a95f-e541cedd48d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da69cd-32b8-4aad-8c3e-cdec929f32bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e1bd3f-e975-4ec3-af1e-16715a5f7574]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:28 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a772a-0eea-4d18-ac76-2cac83d99fd2]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG os_brick.utils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:28 user nova-compute[74932]: INFO nova.compute.manager [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] Swapping volume fa584ebb-400a-4e36-8901-fce6b8cd3179 for ec374f0e-a93b-4b10-a16e-be5eb59b1637
Nov 03 16:26:28 user nova-compute[74932]: DEBUG nova.objects.instance [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lazy-loading 'flavor' on Instance uuid a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-95715a9a-5ef2-41e3-ba0e-18a5bdb3f701 tempest-VolumesAssistedSnapshotsTest-1979799640 tempest-VolumesAssistedSnapshotsTest-1979799640-project-admin] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.204s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:30 user nova-compute[74932]: INFO nova.compute.manager [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Terminating instance
Nov 03 16:26:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-a7506a56-c528-4566-b78a-e8304bbcbbc9 req-a7ff672c-04e5-4fe5-8a75-d428fbcb31a8 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-vif-unplugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a7506a56-c528-4566-b78a-e8304bbcbbc9 req-a7ff672c-04e5-4fe5-8a75-d428fbcb31a8 service nova] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a7506a56-c528-4566-b78a-e8304bbcbbc9 req-a7ff672c-04e5-4fe5-8a75-d428fbcb31a8 service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a7506a56-c528-4566-b78a-e8304bbcbbc9 req-a7ff672c-04e5-4fe5-8a75-d428fbcb31a8 service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-a7506a56-c528-4566-b78a-e8304bbcbbc9 req-a7ff672c-04e5-4fe5-8a75-d428fbcb31a8 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] No waiting events found dispatching network-vif-unplugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-a7506a56-c528-4566-b78a-e8304bbcbbc9 req-a7ff672c-04e5-4fe5-8a75-d428fbcb31a8 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-vif-unplugged-dd4bd921-5395-43ae-927f-090aa8fc0087 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:26:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:31 user nova-compute[74932]: INFO nova.virt.block_device [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Booting with volume 502874ac-5395-44bb-9af3-f5ddcf136ee0 at /dev/vdc
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe034d3-0432-4ee3-bc6f-b0a07958ee04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3338a93c-cc29-404f-a152-e117c09a827d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b7b68-eabd-4006-bfd7-5865916b88a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a874780b-59b5-4beb-83fc-573a37b1cf00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:31 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8534a-744d-4779-8c90-5e65f015b518]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating existing volume attachment record: 4549f6e6-c221-4ed0-8f20-104287d77849 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:26:31 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Instance destroyed successfully.
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.objects.instance [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lazy-loading 'resources' on Instance uuid 4a397eda-4c56-4a53-8aee-2158f9bad2f5 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1530474607',display_name='tempest-ServersNegativeTestJSON-server-1530474607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1530474607',id=10,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a0b7a96b7504dd786bb63ee5504b40d',ramdisk_id='',reservation_id='r-lnwkk91f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1609048425',owner_user_name='tempest-ServersNegativeTestJSON-1609048425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:48Z,user_data=None,user_id='c4bb8e6d69e4480983150ec4cd23a270',uuid=4a397eda-4c56-4a53-8aee-2158f9bad2f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converting VIF {"id": "dd4bd921-5395-43ae-927f-090aa8fc0087", "address": "fa:16:3e:d7:f2:4e", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd4bd921-53", "ovs_interfaceid": "dd4bd921-5395-43ae-927f-090aa8fc0087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG os_vif [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd4bd921-53, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01667602-10ad-48cb-963a-03d03a92ae97) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:26:31 user nova-compute[74932]: INFO os_vif [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f2:4e,bridge_name='br-int',has_traffic_filtering=True,id=dd4bd921-5395-43ae-927f-090aa8fc0087,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd4bd921-53')
Nov 03 16:26:31 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Deleting instance files /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5_del
Nov 03 16:26:31 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Deletion of /opt/stack/data/nova/instances/4a397eda-4c56-4a53-8aee-2158f9bad2f5_del complete
Nov 03 16:26:31 user nova-compute[74932]: INFO nova.compute.manager [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 16:26:31 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:26:31 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:32 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Took 0.58 seconds to deallocate network for instance.
Nov 03 16:26:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-4871f7d8-9de8-4fec-8e45-81e7e2bd406b req-5bbbd8e5-d309-449b-886b-cfd950e07297 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-vif-deleted-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:32 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Deleted allocations for instance 4a397eda-4c56-4a53-8aee-2158f9bad2f5
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-373a17c1-21d7-4406-90a6-f9b268ee5061 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-36d04a69-c607-4c8c-b4cf-aee8666b3703 req-bc40cb19-09fe-4868-ba9a-a506e5aec249 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received event network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-36d04a69-c607-4c8c-b4cf-aee8666b3703 req-bc40cb19-09fe-4868-ba9a-a506e5aec249 service nova] Acquiring lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-36d04a69-c607-4c8c-b4cf-aee8666b3703 req-bc40cb19-09fe-4868-ba9a-a506e5aec249 service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-36d04a69-c607-4c8c-b4cf-aee8666b3703 req-bc40cb19-09fe-4868-ba9a-a506e5aec249 service nova] Lock "4a397eda-4c56-4a53-8aee-2158f9bad2f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-36d04a69-c607-4c8c-b4cf-aee8666b3703 req-bc40cb19-09fe-4868-ba9a-a506e5aec249 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] No waiting events found dispatching network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:32 user nova-compute[74932]: WARNING nova.compute.manager [req-36d04a69-c607-4c8c-b4cf-aee8666b3703 req-bc40cb19-09fe-4868-ba9a-a506e5aec249 service nova] [instance: 4a397eda-4c56-4a53-8aee-2158f9bad2f5] Received unexpected event network-vif-plugged-dd4bd921-5395-43ae-927f-090aa8fc0087 for instance with vm_state deleted and task_state None.
Nov 03 16:26:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:39 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff is timed out.
Nov 03 16:26:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Successfully detached device sdc from instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff from the live domain config.
Nov 03 16:26:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBNnUXkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:39 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[20008a8f-b201-457f-9d4e-0fbd5ac960ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:39 user nova-compute[74932]: No targets found.
Nov 03 16:26:39 user nova-compute[74932]: iSNS:
Nov 03 16:26:39 user nova-compute[74932]: No targets found.
Nov 03 16:26:39 user nova-compute[74932]: STATIC:
Nov 03 16:26:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f
Nov 03 16:26:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e
Nov 03 16:26:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:39 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:39 user nova-compute[74932]: No targets found.
Nov 03 16:26:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:39 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:39 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c545d7a3-c3d4-4436-b268-534cfbc450ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[477ab566-af71-4084-b271-33975e9fae2f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:39 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:39 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:39 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:39 user nova-compute[74932]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f (non-flash)
Nov 03 16:26:39 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:39 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc843a5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f'): ({'sdg'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Removing single pathed devices sdg {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c56791-8421-4f34-ad31-1af936b86608]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c385d42-375f-43ac-a4f2-82e7bafdd433]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Flushing IO for device /dev/sdg {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560b709-a03a-4345-a911-5329f4d62ee7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d17d9-cabb-4e6d-a0dd-03ae85bc2071]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] SCSI volumes sdg have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19195da-248d-4e95-aa60-6ecd6c73d674]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec00660-cde5-42ab-9451-6139e871ab3a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260]
Nov 03 16:26:40 user nova-compute[74932]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a028f717-4874-42b1-a409-22dfc247fc6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c48242-dae9-4106-a26d-7606d37d6c6f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] <== disconnect_volume: return (345ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:40 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:26:43 user nova-compute[74932]: DEBUG nova.objects.instance [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lazy-loading 'flavor' on Instance uuid 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-993af4be-6861-4983-aed0-414d58b96574 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.771s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updating instance_info_cache with network_info: [{"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-03f9c482-d1ad-4300-9be3-afc2e0b0bade" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.volume.cinder [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Update attachment failed for attachment 300175e6-44ac-43d6-8981-6c15fe8d8572. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-145b0f0d-cf98-4d5e-9ed0-ec5bef79e353) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-145b0f0d-cf98-4d5e-9ed0-ec5bef79e353)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] [instance: be942262-61f1-452b-bda1-5185b321477b] Failed to connect to volume ec374f0e-a93b-4b10-a16e-be5eb59b1637 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-145b0f0d-cf98-4d5e-9ed0-ec5bef79e353)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b] Traceback (most recent call last):
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     new_cinfo = self.volume_api.attachment_update(
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     res = method(self, ctx, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     with excutils.save_and_reraise_exception():
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     self.force_reraise()
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     raise self.value
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     return method.func(obj, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     resp = self._update('/attachments/%s' % id, body)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     return self.request(url, method, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b]     raise exceptions.from_response(resp, body)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-145b0f0d-cf98-4d5e-9ed0-ec5bef79e353)
Nov 03 16:26:44 user nova-compute[74932]: ERROR nova.compute.manager [instance: be942262-61f1-452b-bda1-5185b321477b] 
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.objects.instance [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'flavor' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.659s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server [None req-456e6e69-7bc5-4934-b657-7010c1edc27f tempest-TestVolumeSwap-1886201221 tempest-TestVolumeSwap-1886201221-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-145b0f0d-cf98-4d5e-9ed0-ec5bef79e353)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-145b0f0d-cf98-4d5e-9ed0-ec5bef79e353)
Nov 03 16:26:44 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:44 user nova-compute[74932]: INFO nova.compute.manager [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Attaching volume 13b5fdcc-d757-449e-ae07-198e9d622b2f to /dev/vdb
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:44 user nova-compute[74932]: INFO nova.compute.manager [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Terminating instance
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG os_brick.utils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf990a9-5ba6-4e26-aa6c-41b4c1270d93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa033da9-28d9-452a-a8fa-7a5b5790a156]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47086e3-e93f-474a-8ec5-2a73fcec36a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab6bb4-1be7-48e0-9293-4cc9fae6de47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:44 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:26:45 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c337a-ab26-4807-9a36-fe06ac4c6fd0]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG os_brick.utils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating existing volume attachment record: 1b20e13b-5a7e-4a90-b3cc-3dc47fa7f782 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-09034f68-8e1f-460f-bcbb-ccd773b38430 req-97f31fbd-b798-4fff-9e3f-a3b973a30a6b service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-vif-unplugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-09034f68-8e1f-460f-bcbb-ccd773b38430 req-97f31fbd-b798-4fff-9e3f-a3b973a30a6b service nova] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-09034f68-8e1f-460f-bcbb-ccd773b38430 req-97f31fbd-b798-4fff-9e3f-a3b973a30a6b service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-09034f68-8e1f-460f-bcbb-ccd773b38430 req-97f31fbd-b798-4fff-9e3f-a3b973a30a6b service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-09034f68-8e1f-460f-bcbb-ccd773b38430 req-97f31fbd-b798-4fff-9e3f-a3b973a30a6b service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] No waiting events found dispatching network-vif-unplugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-09034f68-8e1f-460f-bcbb-ccd773b38430 req-97f31fbd-b798-4fff-9e3f-a3b973a30a6b service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-vif-unplugged-20ff3adf-2e43-4a1b-af96-adfb112f335b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Instance destroyed successfully.
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lazy-loading 'resources' on Instance uuid 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1419577564',display_name='tempest-AttachSCSIVolumeTestJSON-server-1419577564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1419577564',id=5,image_ref='5f5bea02-2093-495f-a621-678ee64918b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5ul8HM0L2dn2OQV8NeqtHUeIokr5gWbPVndmcGu3ussKu41aM6YSKRSWhuY5+B/XhrqWCYg59tXGv8fAi1mv8/ceMkdpSbf5IfGKtNFFlWmAgrrDMFNIWMhmdghfQGOQ==',key_name='tempest-keypair-68860100',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bf23fb278af4fa78737e5d2e20b00a8',ramdisk_id='',reservation_id='r-nym64i9r',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5f5bea02-2093-495f-a621-678ee64918b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-739319920',owner_user_name='tempest-AttachSCSIVolumeTestJSON-739319920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:23:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d86959c9099144e2855ce994e8e76f6b',uuid=1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Converting VIF {"id": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "address": "fa:16:3e:89:86:42", "network": {"id": "7a336768-0a01-496f-befd-6b5fdac4777b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1586527417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bf23fb278af4fa78737e5d2e20b00a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ff3adf-2e", "ovs_interfaceid": "20ff3adf-2e43-4a1b-af96-adfb112f335b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG os_vif [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20ff3adf-2e, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fb394e4-91f9-4de5-a270-734cd7ba67d7) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:26:45 user nova-compute[74932]: INFO os_vif [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:86:42,bridge_name='br-int',has_traffic_filtering=True,id=20ff3adf-2e43-4a1b-af96-adfb112f335b,network=Network(7a336768-0a01-496f-befd-6b5fdac4777b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ff3adf-2e')
Nov 03 16:26:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Deleting instance files /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff_del
Nov 03 16:26:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Deletion of /opt/stack/data/nova/instances/1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff_del complete
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:45 user nova-compute[74932]: INFO nova.compute.manager [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-5b1bdc6f-425a-44ad-ac5b-44ce963c8967 req-e03622b5-0da6-4024-b0ba-2180078d60fa service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-vif-deleted-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:46 user nova-compute[74932]: INFO nova.compute.manager [req-5b1bdc6f-425a-44ad-ac5b-44ce963c8967 req-e03622b5-0da6-4024-b0ba-2180078d60fa service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Neutron deleted interface 20ff3adf-2e43-4a1b-af96-adfb112f335b; detaching it from the instance and deleting it from the info cache
Nov 03 16:26:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-5b1bdc6f-425a-44ad-ac5b-44ce963c8967 req-e03622b5-0da6-4024-b0ba-2180078d60fa service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:46 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Took 0.93 seconds to deallocate network for instance.
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 318067b8-c589-4008-b154-5220a87e598e is timed out.
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully detached device vdb from instance 318067b8-c589-4008-b154-5220a87e598e from the live domain config.
Nov 03 16:26:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-5b1bdc6f-425a-44ad-ac5b-44ce963c8967 req-e03622b5-0da6-4024-b0ba-2180078d60fa service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Detach interface failed, port_id=20ff3adf-2e43-4a1b-af96-adfb112f335b, reason: Instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANZzQTij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:46 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:26:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff' (instance-00000005)
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f333ba4-1d16-42d3-ad2c-1b1ce135be99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:46 user nova-compute[74932]: No targets found.
Nov 03 16:26:46 user nova-compute[74932]: iSNS:
Nov 03 16:26:46 user nova-compute[74932]: No targets found.
Nov 03 16:26:46 user nova-compute[74932]: STATIC:
Nov 03 16:26:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e
Nov 03 16:26:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:46 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:46 user nova-compute[74932]: No targets found.
Nov 03 16:26:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:46 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:46 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8071e4d1-7822-4d2f-bc1a-6ee47b305b8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc991114-e26c-4a5e-94c6-9365f2487c75 req-a9e7f943-4773-4587-a8c4-5c60a1130e6e service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received event network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc991114-e26c-4a5e-94c6-9365f2487c75 req-a9e7f943-4773-4587-a8c4-5c60a1130e6e service nova] Acquiring lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc991114-e26c-4a5e-94c6-9365f2487c75 req-a9e7f943-4773-4587-a8c4-5c60a1130e6e service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc991114-e26c-4a5e-94c6-9365f2487c75 req-a9e7f943-4773-4587-a8c4-5c60a1130e6e service nova] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc991114-e26c-4a5e-94c6-9365f2487c75 req-a9e7f943-4773-4587-a8c4-5c60a1130e6e service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] No waiting events found dispatching network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:47 user nova-compute[74932]: WARNING nova.compute.manager [req-bc991114-e26c-4a5e-94c6-9365f2487c75 req-a9e7f943-4773-4587-a8c4-5c60a1130e6e service nova] [instance: 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff] Received unexpected event network-vif-plugged-20ff3adf-2e43-4a1b-af96-adfb112f335b for instance with vm_state deleted and task_state None.
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:26:47 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.456016540527344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a713e81-4e07-4287-b914-ec101ea3cacf]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:47 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:47 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:47 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:47 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:47 user nova-compute[74932]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e (non-flash)
Nov 03 16:26:47 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6440cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4086e6-5ba5-45ba-93e7-d5ed5ee26a5d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14bfc95-0d20-42a6-8ddb-bff2ac787828]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1194d7-0938-4ead-bc11-8a0cd15cee54]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[092dfe8a-e071-4916-9226-f993277f88cd]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55bc7f8-f7ca-4aea-b8ff-00184240d19a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bd3c6f-75cb-4268-9285-5cb31620f3ea]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260]
Nov 03 16:26:47 user nova-compute[74932]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:47 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.867s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f94783d-127a-42b9-86a3-bedde216290e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef1b88-63b5-488e-8b88-7d41b45766c1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.285s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.754s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] <== disconnect_volume: return (756ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:47 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Deleted allocations for instance 1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance be942262-61f1-452b-bda1-5185b321477b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance a354117d-a49b-4b2a-be16-8a5ca0b473b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 318067b8-c589-4008-b154-5220a87e598e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d8e7e5d7-df88-4470-99f7-24f015dcf32a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b3ff3b0c-f6db-45bf-a56f-3a4fc2ba1218 tempest-AttachSCSIVolumeTestJSON-739319920 tempest-AttachSCSIVolumeTestJSON-739319920-project-member] Lock "1a5cabfe-0c88-4e99-84f6-1f9f36d6a5ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.997s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:47 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:26:48 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:26:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:26:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:26:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing instance network info cache due to event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG nova.network.neutron [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG nova.network.neutron [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updated VIF entry in instance network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG nova.network.neutron [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68ac23c0-2318-4c80-8bb3-ae143476b17a req-2ee18810-93cd-44f9-a172-8e3df96a811a service nova] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:53 user nova-compute[74932]: INFO nova.compute.manager [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Shelve offloading
Nov 03 16:26:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eda9301-129f-49d6-bde7-cb2c47b8f372 req-f3b207e6-9ba8-4c09-8202-713d070e910b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-unplugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eda9301-129f-49d6-bde7-cb2c47b8f372 req-f3b207e6-9ba8-4c09-8202-713d070e910b service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eda9301-129f-49d6-bde7-cb2c47b8f372 req-f3b207e6-9ba8-4c09-8202-713d070e910b service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eda9301-129f-49d6-bde7-cb2c47b8f372 req-f3b207e6-9ba8-4c09-8202-713d070e910b service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eda9301-129f-49d6-bde7-cb2c47b8f372 req-f3b207e6-9ba8-4c09-8202-713d070e910b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-unplugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:54 user nova-compute[74932]: WARNING nova.compute.manager [req-4eda9301-129f-49d6-bde7-cb2c47b8f372 req-f3b207e6-9ba8-4c09-8202-713d070e910b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-unplugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state active and task_state shelving.
Nov 03 16:26:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance destroyed successfully.
Nov 03 16:26:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:26:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:26:55 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance destroyed successfully.
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'resources' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-420698720',display_name='tempest-TestShelveInstance-server-420698720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-420698720',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YVp4QArOry6wW4DcYHofoyY7wX7kwbaHbXSXApJtuRayIg7cKh+m1UEUtqjFWuXK9/WyPenbGoccvFYqPtZfuINOvxqUn+6cwjpHHFISvh2O1UB10GIoD8ddRfbp8tQ==',key_name='tempest-TestShelveInstance-110969466',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e73625a0f392447c80d434d24b8218eb',ramdisk_id='',reservation_id='r-tw8lmu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1221651483',owner_user_name='tempest-TestShelveInstance-1221651483-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:25:48Z,user_data=None,user_id='dc9effb60d8447f199761e316876ca81',uuid=d8e7e5d7-df88-4470-99f7-24f015dcf32a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converting VIF {"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_vif [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap102e231c-e0, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=412a9109-b761-4723-a2b9-63462a8ac66a) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.compute.manager [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.compute.manager [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing instance network info cache due to event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.network.neutron [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:26:55 user nova-compute[74932]: INFO os_vif [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0')
Nov 03 16:26:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:26:55 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68bf9f-1729-4a85-9032-629fe8231665]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:26:55 user nova-compute[74932]: No targets found.
Nov 03 16:26:55 user nova-compute[74932]: iSNS:
Nov 03 16:26:55 user nova-compute[74932]: No targets found.
Nov 03 16:26:55 user nova-compute[74932]: STATIC:
Nov 03 16:26:55 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:26:55 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:55 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:55 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:26:55 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:26:55 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:26:55 user nova-compute[74932]: FIRMWARE:
Nov 03 16:26:55 user nova-compute[74932]: No targets found.
Nov 03 16:26:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:26:55 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:26:55 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33dc122-8458-429b-a575-59415da5fdaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef4f467-f352-489a-9a81-c0589d720d3e]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:55 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:26:55 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:26:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8410e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60'): ({'sde'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Removing single pathed devices sde {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c06c24-17a6-43ae-8cee-9d5d1ea7886b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b05a6-db60-4fd2-8b8f-17a86587ef2d]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Flushing IO for device /dev/sde {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf1757-923c-4847-97c1-79f2603638d9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[569a6ecc-cde7-4bf5-9120-d338c0d2ee50]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06fd2a-0a7c-42b0-8bae-f950b7d3aa5f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[789da289-cecc-4aaf-8629-44b08c64ce5c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]
Nov 03 16:26:55 user nova-compute[74932]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.
Nov 03 16:26:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7aa643-189e-4ba8-8167-1c15dce8181a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] <== disconnect_volume: return (325ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:26:56 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Deleting instance files /opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a_del
Nov 03 16:26:56 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Deletion of /opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a_del complete
Nov 03 16:26:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updated VIF entry in instance network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": null, "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap102e231c-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-27f0f0b7-95aa-4ef0-aa22-d8773f3c6c82 req-5518010f-c774-4588-846b-928e24b6ad4b service nova] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-a49406be-0c60-4061-a49d-4149ad07a697 req-096688b7-3c12-4190-9596-6f734ec46667 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a49406be-0c60-4061-a49d-4149ad07a697 req-096688b7-3c12-4190-9596-6f734ec46667 service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a49406be-0c60-4061-a49d-4149ad07a697 req-096688b7-3c12-4190-9596-6f734ec46667 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a49406be-0c60-4061-a49d-4149ad07a697 req-096688b7-3c12-4190-9596-6f734ec46667 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:26:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-a49406be-0c60-4061-a49d-4149ad07a697 req-096688b7-3c12-4190-9596-6f734ec46667 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:26:56 user nova-compute[74932]: WARNING nova.compute.manager [req-a49406be-0c60-4061-a49d-4149ad07a697 req-096688b7-3c12-4190-9596-6f734ec46667 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state active and task_state shelving.
Nov 03 16:26:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'flavor' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8453c467-c1d1-4d0c-a61e-fad55594ed04 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 41.178s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "interface-318067b8-c589-4008-b154-5220a87e598e-a4413064-969d-4c4c-8559-48c43de58f8b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "interface-318067b8-c589-4008-b154-5220a87e598e-a4413064-969d-4c4c-8559-48c43de58f8b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'flavor' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface> {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface> {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Attempting to detach device tapa4413064-96 from instance 318067b8-c589-4008-b154-5220a87e598e from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] detach device xml: <interface type="ethernet">
Nov 03 16:27:07 user nova-compute[74932]:   <mac address="fa:16:3e:cf:41:70"/>
Nov 03 16:27:07 user nova-compute[74932]:   <model type="virtio"/>
Nov 03 16:27:07 user nova-compute[74932]:   <mtu size="1442"/>
Nov 03 16:27:07 user nova-compute[74932]:   <target dev="tapa4413064-96"/>
Nov 03 16:27:07 user nova-compute[74932]: </interface>
Nov 03 16:27:07 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface> {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 03 16:27:07 user nova-compute[74932]:   <name>instance-00000008</name>
Nov 03 16:27:07 user nova-compute[74932]:   <uuid>318067b8-c589-4008-b154-5220a87e598e</uuid>
Nov 03 16:27:07 user nova-compute[74932]:   <metadata>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:07 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:27:07 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:27:07 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:25:55</nova:creationTime>
Nov 03 16:27:07 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:27:07 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:07 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:27:07 user nova-compute[74932]:   <nova:owner>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:27:07 user nova-compute[74932]:   </nova:owner>
Nov 03 16:27:07 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:07 user nova-compute[74932]:   <nova:ports>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:27:07 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:27:07 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:07 user nova-compute[74932]:     <nova:port uuid="a4413064-969d-4c4c-8559-48c43de58f8b">
Nov 03 16:27:07 user nova-compute[74932]:       <nova:ip type="fixed" address="10.10.10.249" ipVersion="4"/>
Nov 03 16:27:07 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:07 user nova-compute[74932]:   </nova:ports>
Nov 03 16:27:07 user nova-compute[74932]: </nova:instance>
Nov 03 16:27:07 user nova-compute[74932]:   </metadata>
Nov 03 16:27:07 user nova-compute[74932]:   <memory unit='KiB'>524288</memory>
Nov 03 16:27:07 user nova-compute[74932]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 16:27:07 user nova-compute[74932]:   <vcpu placement='static'>1</vcpu>
Nov 03 16:27:07 user nova-compute[74932]:   <resource>
Nov 03 16:27:07 user nova-compute[74932]:     <partition>/machine</partition>
Nov 03 16:27:07 user nova-compute[74932]:   </resource>
Nov 03 16:27:07 user nova-compute[74932]:   <sysinfo type='smbios'>
Nov 03 16:27:07 user nova-compute[74932]:     <system>
Nov 03 16:27:07 user nova-compute[74932]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 16:27:07 user nova-compute[74932]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 16:27:07 user nova-compute[74932]:       <entry name='version'>0.0.0</entry>
Nov 03 16:27:07 user nova-compute[74932]:       <entry name='serial'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:07 user nova-compute[74932]:       <entry name='uuid'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:07 user nova-compute[74932]:       <entry name='family'>Virtual Machine</entry>
Nov 03 16:27:07 user nova-compute[74932]:     </system>
Nov 03 16:27:07 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:07 user nova-compute[74932]:   <os>
Nov 03 16:27:07 user nova-compute[74932]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 16:27:07 user nova-compute[74932]:     <boot dev='hd'/>
Nov 03 16:27:07 user nova-compute[74932]:     <smbios mode='sysinfo'/>
Nov 03 16:27:07 user nova-compute[74932]:   </os>
Nov 03 16:27:07 user nova-compute[74932]:   <features>
Nov 03 16:27:07 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:07 user nova-compute[74932]:     <apic/>
Nov 03 16:27:07 user nova-compute[74932]:     <vmcoreinfo state='on'/>
Nov 03 16:27:07 user nova-compute[74932]:   </features>
Nov 03 16:27:07 user nova-compute[74932]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 16:27:07 user nova-compute[74932]:     <model fallback='forbid'>Nehalem</model>
Nov 03 16:27:07 user nova-compute[74932]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 16:27:07 user nova-compute[74932]:     <feature policy='require' name='vme'/>
Nov 03 16:27:07 user nova-compute[74932]:     <feature policy='require' name='x2apic'/>
Nov 03 16:27:07 user nova-compute[74932]:     <feature policy='require' name='hypervisor'/>
Nov 03 16:27:07 user nova-compute[74932]:   </cpu>
Nov 03 16:27:07 user nova-compute[74932]:   <clock offset='utc'>
Nov 03 16:27:07 user nova-compute[74932]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 16:27:07 user nova-compute[74932]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 16:27:07 user nova-compute[74932]:     <timer name='hpet' present='no'/>
Nov 03 16:27:07 user nova-compute[74932]:   </clock>
Nov 03 16:27:07 user nova-compute[74932]:   <on_poweroff>destroy</on_poweroff>
Nov 03 16:27:07 user nova-compute[74932]:   <on_reboot>restart</on_reboot>
Nov 03 16:27:07 user nova-compute[74932]:   <on_crash>destroy</on_crash>
Nov 03 16:27:07 user nova-compute[74932]:   <devices>
Nov 03 16:27:07 user nova-compute[74932]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 16:27:07 user nova-compute[74932]:     <disk type='file' device='disk'>
Nov 03 16:27:07 user nova-compute[74932]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 16:27:07 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk' index='2'/>
Nov 03 16:27:07 user nova-compute[74932]:       <backingStore type='file' index='3'>
Nov 03 16:27:07 user nova-compute[74932]:         <format type='raw'/>
Nov 03 16:27:07 user nova-compute[74932]:         <source file='/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2'/>
Nov 03 16:27:07 user nova-compute[74932]:         <backingStore/>
Nov 03 16:27:07 user nova-compute[74932]:       </backingStore>
Nov 03 16:27:07 user nova-compute[74932]:       <target dev='vda' bus='virtio'/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='virtio-disk0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </disk>
Nov 03 16:27:07 user nova-compute[74932]:     <disk type='file' device='cdrom'>
Nov 03 16:27:07 user nova-compute[74932]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 16:27:07 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config' index='1'/>
Nov 03 16:27:07 user nova-compute[74932]:       <backingStore/>
Nov 03 16:27:07 user nova-compute[74932]:       <target dev='hda' bus='ide'/>
Nov 03 16:27:07 user nova-compute[74932]:       <readonly/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='ide0-0-0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </disk>
Nov 03 16:27:07 user nova-compute[74932]:     <controller type='usb' index='0' model='none'>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='usb'/>
Nov 03 16:27:07 user nova-compute[74932]:     </controller>
Nov 03 16:27:07 user nova-compute[74932]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='pci.0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </controller>
Nov 03 16:27:07 user nova-compute[74932]:     <controller type='ide' index='0'>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='ide'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 16:27:07 user nova-compute[74932]:     </controller>
Nov 03 16:27:07 user nova-compute[74932]:     <interface type='ethernet'>
Nov 03 16:27:07 user nova-compute[74932]:       <mac address='fa:16:3e:f8:5a:db'/>
Nov 03 16:27:07 user nova-compute[74932]:       <target dev='tap9ca44a20-17'/>
Nov 03 16:27:07 user nova-compute[74932]:       <model type='virtio'/>
Nov 03 16:27:07 user nova-compute[74932]:       <mtu size='1442'/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='net0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </interface>
Nov 03 16:27:07 user nova-compute[74932]:     <interface type='ethernet'>
Nov 03 16:27:07 user nova-compute[74932]:       <mac address='fa:16:3e:cf:41:70'/>
Nov 03 16:27:07 user nova-compute[74932]:       <target dev='tapa4413064-96'/>
Nov 03 16:27:07 user nova-compute[74932]:       <model type='virtio'/>
Nov 03 16:27:07 user nova-compute[74932]:       <mtu size='1442'/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='net1'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </interface>
Nov 03 16:27:07 user nova-compute[74932]:     <serial type='pty'>
Nov 03 16:27:07 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:07 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:07 user nova-compute[74932]:       <target type='isa-serial' port='0'>
Nov 03 16:27:07 user nova-compute[74932]:         <model name='isa-serial'/>
Nov 03 16:27:07 user nova-compute[74932]:       </target>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </serial>
Nov 03 16:27:07 user nova-compute[74932]:     <console type='pty' tty='/dev/pts/7'>
Nov 03 16:27:07 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:07 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:07 user nova-compute[74932]:       <target type='serial' port='0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </console>
Nov 03 16:27:07 user nova-compute[74932]:     <input type='mouse' bus='ps2'>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='input0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </input>
Nov 03 16:27:07 user nova-compute[74932]:     <input type='keyboard' bus='ps2'>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='input1'/>
Nov 03 16:27:07 user nova-compute[74932]:     </input>
Nov 03 16:27:07 user nova-compute[74932]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 03 16:27:07 user nova-compute[74932]:       <listen type='address' address='0.0.0.0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </graphics>
Nov 03 16:27:07 user nova-compute[74932]:     <audio id='1' type='none'/>
Nov 03 16:27:07 user nova-compute[74932]:     <video>
Nov 03 16:27:07 user nova-compute[74932]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='video0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </video>
Nov 03 16:27:07 user nova-compute[74932]:     <memballoon model='virtio'>
Nov 03 16:27:07 user nova-compute[74932]:       <stats period='10'/>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='balloon0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:07 user nova-compute[74932]:     <rng model='virtio'>
Nov 03 16:27:07 user nova-compute[74932]:       <backend model='random'>/dev/urandom</backend>
Nov 03 16:27:07 user nova-compute[74932]:       <alias name='rng0'/>
Nov 03 16:27:07 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 16:27:07 user nova-compute[74932]:     </rng>
Nov 03 16:27:07 user nova-compute[74932]:   </devices>
Nov 03 16:27:07 user nova-compute[74932]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 16:27:07 user nova-compute[74932]:     <label>libvirt-318067b8-c589-4008-b154-5220a87e598e</label>
Nov 03 16:27:07 user nova-compute[74932]:     <imagelabel>libvirt-318067b8-c589-4008-b154-5220a87e598e</imagelabel>
Nov 03 16:27:07 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:07 user nova-compute[74932]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 16:27:07 user nova-compute[74932]:     <label>+64055:+108</label>
Nov 03 16:27:07 user nova-compute[74932]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 16:27:07 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:07 user nova-compute[74932]: </domain>
Nov 03 16:27:07 user nova-compute[74932]:  {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 16:27:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully detached device tapa4413064-96 from instance 318067b8-c589-4008-b154-5220a87e598e from the persistent domain config.
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] (1/8): Attempting to detach device tapa4413064-96 with device alias net1 from instance 318067b8-c589-4008-b154-5220a87e598e from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] detach device xml: <interface type="ethernet">
Nov 03 16:27:07 user nova-compute[74932]:   <mac address="fa:16:3e:cf:41:70"/>
Nov 03 16:27:07 user nova-compute[74932]:   <model type="virtio"/>
Nov 03 16:27:07 user nova-compute[74932]:   <mtu size="1442"/>
Nov 03 16:27:07 user nova-compute[74932]:   <target dev="tapa4413064-96"/>
Nov 03 16:27:07 user nova-compute[74932]: </interface>
Nov 03 16:27:07 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:27:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Creating image(s)
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Ensure instance console log exists: /opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Start _get_guest_xml network_info=[{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJnOyiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3583d6b-22b6-4d6a-9126-eb15a6febfcc', 'serial': 'b3583d6b-22b6-4d6a-9126-eb15a6febfcc'}, 'attachment_id': '16384707-2dc2-4d3a-b831-c9beb97cb11b', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoSrWPBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072', 'attached_at': '', 'detached_at': '', 'volume_id': '6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7', 'serial': '6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7'}, 'attachment_id': 'fc727624-79a1-4305-9dd9-a9d300af45dd', 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMSVuviP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072', 'attached_at': '', 'detached_at': '', 'volume_id': '502874ac-5395-44bb-9af3-f5ddcf136ee0', 'serial': '502874ac-5395-44bb-9af3-f5ddcf136ee0'}, 'attachment_id': '4549f6e6-c221-4ed0-8f20-104287d77849', 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:27:07 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:07 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJnOyiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:07 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[30913ea0-aebb-4f3d-9469-2b072fd21409]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:27:07 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd9333-8c97-4d4b-a6d0-597d9fa536fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc] added
Nov 03 16:27:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a5274-a4f0-47ba-bd57-259a07d3a462]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521c058-0a3f-4b37-b451-11b7271b6018]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsJnOyiD {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsJnOyiD" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c68974-fb8f-42f4-9091-ddf66f901cce]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tsJnOyiD'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62a9c18-f3e2-40ad-b3c0-04e85eacee2b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc41641d-ae1f-49b3-8c76-e5d0f260472d]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:08 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:08 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Start waiting for the detach event from libvirt for device tapa4413064-96 with device alias net1 for instance 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d28aa-fd31-4c9f-8ae9-30e524b3f39b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260]
Nov 03 16:27:08 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:08 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5829f33c-b210-411e-b226-ce427652aa24]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-027b72a8-7b5a-4ba5-9bc9-40c9b7d06f38 req-1ba40d62-b9b9-4799-a56a-6ad1efcfa1c4 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-unplugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-027b72a8-7b5a-4ba5-9bc9-40c9b7d06f38 req-1ba40d62-b9b9-4799-a56a-6ad1efcfa1c4 service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-027b72a8-7b5a-4ba5-9bc9-40c9b7d06f38 req-1ba40d62-b9b9-4799-a56a-6ad1efcfa1c4 service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-027b72a8-7b5a-4ba5-9bc9-40c9b7d06f38 req-1ba40d62-b9b9-4799-a56a-6ad1efcfa1c4 service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-027b72a8-7b5a-4ba5-9bc9-40c9b7d06f38 req-1ba40d62-b9b9-4799-a56a-6ad1efcfa1c4 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-unplugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:08 user nova-compute[74932]: WARNING nova.compute.manager [req-027b72a8-7b5a-4ba5-9bc9-40c9b7d06f38 req-1ba40d62-b9b9-4799-a56a-6ad1efcfa1c4 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-unplugged-a4413064-969d-4c4c-8559-48c43de58f8b for instance with vm_state active and task_state None.
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[96864bc6-9c89-46c4-b116-77a3cca9f274]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:08 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:08 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:08 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:08 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[93270813-805b-4439-81bc-6ee76b0ca2b1]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJnOyiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:27:08 user nova-compute[74932]: INFO nova.compute.claims [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Claim successful on node user
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:09 user nova-compute[74932]: INFO nova.compute.manager [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Unshelving
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26335336465393431', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335336465393431', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.431s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:09 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:09 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: INFO nova.virt.block_device [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Booting with volume c49daba7-6951-4cac-9b1d-bafe28733fd8 at /dev/vdc
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c2cd2e-e840-45ad-a1b9-3c12e4002090]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:27:09 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoSrWPBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:09 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8b2e6b-c902-4581-9f22-d7c40ea32af1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f] added
Nov 03 16:27:09 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.utils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d8ff2-a6c7-4874-831f-cd5a3071c23a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f477b-9ed4-468a-9a79-69c8107b1ff4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73bb5b-3b10-4ffc-a69b-c3b08724a788]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETVOdxnp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb21aae-1ddf-4e14-9e98-59cdb469ed4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETVOdxnp" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd74fa53-0b6a-4322-80a4-52c261c7749f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETVOdxnp'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b5b7b-3385-4836-b0ca-4c3baa4eb8c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32f1999-74ff-4da9-8174-a38a82391760]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e9a02d-9e9b-4c38-9d1f-07a308f4834d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:27:09 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aac62e-cebf-47c4-a2ef-505ec56c33bb]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.utils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating existing volume attachment record: 2e53e13f-829a-4cd8-909b-e0d13f2fcd75 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4263e71d-c443-427a-94af-940677e76b64]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:09 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:09 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:09 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:09 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[69202f5d-072c-4d2d-83f1-81188dd720d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]
Nov 03 16:27:09 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:09 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c7020-d0a3-4431-9632-e24b1959d334]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d7eb0-3cde-441c-a87b-a12870493f67]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:09 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:09 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:09 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:09 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:09 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:09 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5b8951-8e65-418d-bd43-aa69fced9dc2]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:27:09 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.policy [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f75f8149b74615b3a1e3cf77de2d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb89089043442b980d4d230bb608ad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:27:09 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Creating image(s)
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "/opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "/opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "/opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-4ac12e51-e8b1-4f90-9f7f-f2415a7e59c8 req-58eafcdf-2827-42ae-9e05-6b29d676cfef service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4ac12e51-e8b1-4f90-9f7f-f2415a7e59c8 req-58eafcdf-2827-42ae-9e05-6b29d676cfef service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4ac12e51-e8b1-4f90-9f7f-f2415a7e59c8 req-58eafcdf-2827-42ae-9e05-6b29d676cfef service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4ac12e51-e8b1-4f90-9f7f-f2415a7e59c8 req-58eafcdf-2827-42ae-9e05-6b29d676cfef service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-4ac12e51-e8b1-4f90-9f7f-f2415a7e59c8 req-58eafcdf-2827-42ae-9e05-6b29d676cfef service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:10 user nova-compute[74932]: WARNING nova.compute.manager [req-4ac12e51-e8b1-4f90-9f7f-f2415a7e59c8 req-58eafcdf-2827-42ae-9e05-6b29d676cfef service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-plugged-a4413064-969d-4c4c-8559-48c43de58f8b for instance with vm_state active and task_state None.
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk 1073741824" returned: 0 in 0.062s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Successfully created port: 0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== connect_volume: return (2850ms) {'type': 'block', 'scsi_wwn': '23462386631663662', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462386631663662', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.387s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:10 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:10 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.objects.instance [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'flavor' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3c537a-fd8f-4013-a4b4-4d98156cf3e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:27:10 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:27:10 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:27:10 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:27:10 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:27:10 user nova-compute[74932]:   <serial>13b5fdcc-d757-449e-ae07-198e9d622b2f</serial>
Nov 03 16:27:10 user nova-compute[74932]: </disk>
Nov 03 16:27:10 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e43a80-cc91-46e5-8b18-5f7efc5c7277]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7] added
Nov 03 16:27:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Cannot resize image /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Ensure instance console log exists: /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[214743c1-2592-4f3b-95ae-8e2ecff622b2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef54d3-cd6c-46fb-a916-679cd19e2f2f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoSrWPBV {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoSrWPBV" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc479b-d8e9-4341-af92-87d210b34608]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yoSrWPBV'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d5c3b2-6875-4219-97ee-970f73286617]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ed555e-752a-41e3-b86e-42c2fec24f94]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f067066f-9e9e-4826-a2f2-70d1708cb62a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260]
Nov 03 16:27:10 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f18b2d-149d-4d92-9b08-5bf785b09c7c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[180b7590-1e58-4f73-a5bb-2b5ea1070372]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5844b89e-8787-4b3c-ba3c-0d918e889401]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoSrWPBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Successfully updated port: 0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "refresh_cache-a06239ec-5943-4ca5-a9f8-5421c3a6528d" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquired lock "refresh_cache-a06239ec-5943-4ca5-a9f8-5421c3a6528d" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-changed-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Refreshing instance network info cache due to event network-changed-0908e8a0-0a0c-45cc-be06-8334aae599ad. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:27:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] Acquiring lock "refresh_cache-a06239ec-5943-4ca5-a9f8-5421c3a6528d" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No VIF found with MAC fa:16:3e:d0:fa:36, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8e11308b-3c36-454c-bad9-a95c140431ba tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.414s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Updating instance_info_cache with network_info: [{"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Releasing lock "refresh_cache-a06239ec-5943-4ca5-a9f8-5421c3a6528d" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Instance network_info: |[{"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] Acquired lock "refresh_cache-a06239ec-5943-4ca5-a9f8-5421c3a6528d" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Refreshing network info cache for port 0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Start _get_guest_xml network_info=[{"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:27:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-365318984',display_name='tempest-VolumesAdminNegativeTest-server-365318984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-365318984',id=13,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb89089043442b980d4d230bb608ad6',ramdisk_id='',reservation_id='r-7p45xafp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-164723280',owner_user_name='tempest-VolumesAdminNegativeTest-164723280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:10Z,user_data=None,user_id='21f75f8149b74615b3a1e3cf77de2d5e',uuid=a06239ec-5943-4ca5-a9f8-5421c3a6528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converting VIF {"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.objects.instance [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'pci_devices' on Instance uuid a06239ec-5943-4ca5-a9f8-5421c3a6528d {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:27:11 user nova-compute[74932]:   <uuid>a06239ec-5943-4ca5-a9f8-5421c3a6528d</uuid>
Nov 03 16:27:11 user nova-compute[74932]:   <name>instance-0000000d</name>
Nov 03 16:27:11 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:27:11 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:27:11 user nova-compute[74932]:   <metadata>
Nov 03 16:27:11 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:11 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:27:11 user nova-compute[74932]:       <nova:name>tempest-VolumesAdminNegativeTest-server-365318984</nova:name>
Nov 03 16:27:11 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:27:11</nova:creationTime>
Nov 03 16:27:11 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:27:11 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:11 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:27:11 user nova-compute[74932]:       <nova:owner>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:user uuid="21f75f8149b74615b3a1e3cf77de2d5e">tempest-VolumesAdminNegativeTest-164723280-project-member</nova:user>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:project uuid="eeb89089043442b980d4d230bb608ad6">tempest-VolumesAdminNegativeTest-164723280</nova:project>
Nov 03 16:27:11 user nova-compute[74932]:       </nova:owner>
Nov 03 16:27:11 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:11 user nova-compute[74932]:       <nova:ports>
Nov 03 16:27:11 user nova-compute[74932]:         <nova:port uuid="0908e8a0-0a0c-45cc-be06-8334aae599ad">
Nov 03 16:27:11 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 16:27:11 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:11 user nova-compute[74932]:       </nova:ports>
Nov 03 16:27:11 user nova-compute[74932]:     </nova:instance>
Nov 03 16:27:11 user nova-compute[74932]:   </metadata>
Nov 03 16:27:11 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:27:11 user nova-compute[74932]:     <system>
Nov 03 16:27:11 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:27:11 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:27:11 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:27:11 user nova-compute[74932]:       <entry name="serial">a06239ec-5943-4ca5-a9f8-5421c3a6528d</entry>
Nov 03 16:27:11 user nova-compute[74932]:       <entry name="uuid">a06239ec-5943-4ca5-a9f8-5421c3a6528d</entry>
Nov 03 16:27:11 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:27:11 user nova-compute[74932]:     </system>
Nov 03 16:27:11 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:11 user nova-compute[74932]:   <os>
Nov 03 16:27:11 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:27:11 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:27:11 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:27:11 user nova-compute[74932]:   </os>
Nov 03 16:27:11 user nova-compute[74932]:   <features>
Nov 03 16:27:11 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:11 user nova-compute[74932]:     <apic/>
Nov 03 16:27:11 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:27:11 user nova-compute[74932]:   </features>
Nov 03 16:27:11 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:27:11 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:27:11 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:27:11 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:27:11 user nova-compute[74932]:   </clock>
Nov 03 16:27:11 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:27:11 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:27:11 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:27:11 user nova-compute[74932]:   </cpu>
Nov 03 16:27:11 user nova-compute[74932]:   <devices>
Nov 03 16:27:11 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:27:11 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:27:11 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk"/>
Nov 03 16:27:11 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:27:11 user nova-compute[74932]:     </disk>
Nov 03 16:27:11 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:11 user nova-compute[74932]:       <mac address="fa:16:3e:96:ff:cf"/>
Nov 03 16:27:11 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:11 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:11 user nova-compute[74932]:       <target dev="tap0908e8a0-0a"/>
Nov 03 16:27:11 user nova-compute[74932]:     </interface>
Nov 03 16:27:11 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:27:11 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/console.log" append="off"/>
Nov 03 16:27:11 user nova-compute[74932]:     </serial>
Nov 03 16:27:11 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:27:11 user nova-compute[74932]:     <video>
Nov 03 16:27:11 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:11 user nova-compute[74932]:     </video>
Nov 03 16:27:11 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:27:11 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:27:11 user nova-compute[74932]:     </rng>
Nov 03 16:27:11 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:27:11 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:27:11 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:27:11 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:11 user nova-compute[74932]:   </devices>
Nov 03 16:27:11 user nova-compute[74932]: </domain>
Nov 03 16:27:11 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-365318984',display_name='tempest-VolumesAdminNegativeTest-server-365318984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-365318984',id=13,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb89089043442b980d4d230bb608ad6',ramdisk_id='',reservation_id='r-7p45xafp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-164723280',owner_user_name='tempest-VolumesAdminNegativeTest-164723280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:10Z,user_data=None,user_id='21f75f8149b74615b3a1e3cf77de2d5e',uuid=a06239ec-5943-4ca5-a9f8-5421c3a6528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converting VIF {"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_vif [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fd509f8-0f69-560f-8beb-5e16a724c4fb', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0908e8a0-0a, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0908e8a0-0a, col_values=(('qos', UUID('382430fc-b714-4fdc-ad85-7f6f4b3ab605')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0908e8a0-0a, col_values=(('external_ids', {'iface-id': '0908e8a0-0a0c-45cc-be06-8334aae599ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ff:cf', 'vm-uuid': 'a06239ec-5943-4ca5-a9f8-5421c3a6528d'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:11 user nova-compute[74932]: INFO os_vif [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a')
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] No VIF found with MAC fa:16:3e:96:ff:cf, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Updated VIF entry in instance network info cache for port 0908e8a0-0a0c-45cc-be06-8334aae599ad. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Updating instance_info_cache with network_info: [{"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5787791-da69-49e1-8575-3883087fef9a req-6ea04d02-6329-4778-be0a-f65a13e43a77 service nova] Releasing lock "refresh_cache-a06239ec-5943-4ca5-a9f8-5421c3a6528d" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== connect_volume: return (2772ms) {'type': 'block', 'scsi_wwn': '23435646161306564', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435646161306564', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMSVuviP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:11 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a38f63-369a-4465-aab6-3cdbe0dad3dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:27:11 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a611d43c-c3fa-441a-bfbd-d36ddf1b9d4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0] added
Nov 03 16:27:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9032c806-cdab-41d8-9f2d-d868ca0490af]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af5d060-416c-4e9b-a1f7-46709eaa49a4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMSVuviP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMSVuviP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d1629b-3829-4099-b770-0a908602734d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMSVuviP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5fa6a0-a878-495e-ba41-59cbe2971462]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[13106cae-6bcd-4206-8207-73dda948ba44]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c03339-e295-4978-a68a-6a4e3411b1c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260]
Nov 03 16:27:12 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb224693-8914-4d2d-bc60-1fbe2e2e0dcc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae6b6fb-e897-41e2-9165-516020c01f89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f99fea-5481-4058-b713-ce48546abaf4]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMSVuviP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:27:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-725a02b0-5abb-44e7-9e32-cf2e3c29bea3 req-3d13bd2e-e595-415f-a526-f6739c292b91 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-725a02b0-5abb-44e7-9e32-cf2e3c29bea3 req-3d13bd2e-e595-415f-a526-f6739c292b91 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-725a02b0-5abb-44e7-9e32-cf2e3c29bea3 req-3d13bd2e-e595-415f-a526-f6739c292b91 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-725a02b0-5abb-44e7-9e32-cf2e3c29bea3 req-3d13bd2e-e595-415f-a526-f6739c292b91 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-725a02b0-5abb-44e7-9e32-cf2e3c29bea3 req-3d13bd2e-e595-415f-a526-f6739c292b91 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:13 user nova-compute[74932]: WARNING nova.compute.manager [req-725a02b0-5abb-44e7-9e32-cf2e3c29bea3 req-3d13bd2e-e595-415f-a526-f6739c292b91 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state building and task_state spawning.
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26436353736393766', 'path': '/dev/sde'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436353736393766', 'path': '/dev/sde'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lazy-loading 'pci_devices' on Instance uuid caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Stashing vm_state: active {{(pid=74932) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:27:13 user nova-compute[74932]:   <uuid>caf006bb-ea6d-4d96-a6d6-dd9cb51cd072</uuid>
Nov 03 16:27:13 user nova-compute[74932]:   <name>instance-0000000c</name>
Nov 03 16:27:13 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:27:13 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:27:13 user nova-compute[74932]:   <metadata>
Nov 03 16:27:13 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:13 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:27:13 user nova-compute[74932]:       <nova:name>tempest-device-tagging-server-1733698274</nova:name>
Nov 03 16:27:13 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:27:07</nova:creationTime>
Nov 03 16:27:13 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:27:13 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:13 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:27:13 user nova-compute[74932]:       <nova:owner>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:user uuid="0014382a16714a6ea8f480165b94d8e9">tempest-TaggedBootDevicesTest-47404985-project-member</nova:user>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:project uuid="11d7e1c111a34d35930b25a5357ae5db">tempest-TaggedBootDevicesTest-47404985</nova:project>
Nov 03 16:27:13 user nova-compute[74932]:       </nova:owner>
Nov 03 16:27:13 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:13 user nova-compute[74932]:       <nova:ports>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="f5008f1b-5165-4d01-823e-4d4c3fc4d5cc">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="2507f374-275d-4c75-8a34-64a9e36eed8d">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="a20486a5-f54d-4f05-828d-dfbc6b0cb66d">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="0bfd246d-a03a-4e06-9e68-499e2ce5c73e">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="348c7c87-85a8-41e6-a214-6170a5b2d721">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:         <nova:port uuid="61357ead-7a4e-4809-8640-dbf23410df4f">
Nov 03 16:27:13 user nova-compute[74932]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 16:27:13 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:13 user nova-compute[74932]:       </nova:ports>
Nov 03 16:27:13 user nova-compute[74932]:     </nova:instance>
Nov 03 16:27:13 user nova-compute[74932]:   </metadata>
Nov 03 16:27:13 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:27:13 user nova-compute[74932]:     <system>
Nov 03 16:27:13 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:27:13 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:27:13 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:27:13 user nova-compute[74932]:       <entry name="serial">caf006bb-ea6d-4d96-a6d6-dd9cb51cd072</entry>
Nov 03 16:27:13 user nova-compute[74932]:       <entry name="uuid">caf006bb-ea6d-4d96-a6d6-dd9cb51cd072</entry>
Nov 03 16:27:13 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:27:13 user nova-compute[74932]:     </system>
Nov 03 16:27:13 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:13 user nova-compute[74932]:   <os>
Nov 03 16:27:13 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:27:13 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:27:13 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:27:13 user nova-compute[74932]:   </os>
Nov 03 16:27:13 user nova-compute[74932]:   <features>
Nov 03 16:27:13 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:13 user nova-compute[74932]:     <apic/>
Nov 03 16:27:13 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:27:13 user nova-compute[74932]:   </features>
Nov 03 16:27:13 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:27:13 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:27:13 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:27:13 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:27:13 user nova-compute[74932]:   </clock>
Nov 03 16:27:13 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:27:13 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:27:13 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:27:13 user nova-compute[74932]:   </cpu>
Nov 03 16:27:13 user nova-compute[74932]:   <devices>
Nov 03 16:27:13 user nova-compute[74932]:     <disk type="file" device="cdrom">
Nov 03 16:27:13 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 16:27:13 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072/disk.config"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="hda" bus="ide"/>
Nov 03 16:27:13 user nova-compute[74932]:     </disk>
Nov 03 16:27:13 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:27:13 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:27:13 user nova-compute[74932]:       <source dev="/dev/sdb"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <serial>b3583d6b-22b6-4d6a-9126-eb15a6febfcc</serial>
Nov 03 16:27:13 user nova-compute[74932]:     </disk>
Nov 03 16:27:13 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:27:13 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:27:13 user nova-compute[74932]:       <source dev="/dev/sdd"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <serial>6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7</serial>
Nov 03 16:27:13 user nova-compute[74932]:     </disk>
Nov 03 16:27:13 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:27:13 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:27:13 user nova-compute[74932]:       <source dev="/dev/sde"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="vdc" bus="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <serial>502874ac-5395-44bb-9af3-f5ddcf136ee0</serial>
Nov 03 16:27:13 user nova-compute[74932]:     </disk>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:d6:4b:c0"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tapf5008f1b-51"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:95:1b:26"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tap2507f374-27"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:4d:7d:c2"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tap5f4d454e-94"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:e4:9d:48"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tapa20486a5-f5"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:0a:d7:de"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tap0bfd246d-a0"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:1c:6b:ed"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tap348c7c87-85"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:13 user nova-compute[74932]:       <mac address="fa:16:3e:c7:bd:49"/>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:13 user nova-compute[74932]:       <target dev="tap61357ead-7a"/>
Nov 03 16:27:13 user nova-compute[74932]:     </interface>
Nov 03 16:27:13 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:27:13 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072/console.log" append="off"/>
Nov 03 16:27:13 user nova-compute[74932]:     </serial>
Nov 03 16:27:13 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:27:13 user nova-compute[74932]:     <video>
Nov 03 16:27:13 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:13 user nova-compute[74932]:     </video>
Nov 03 16:27:13 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:27:13 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:27:13 user nova-compute[74932]:     </rng>
Nov 03 16:27:13 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:27:13 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:27:13 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:27:13 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:13 user nova-compute[74932]:   </devices>
Nov 03 16:27:13 user nova-compute[74932]: </domain>
Nov 03 16:27:13 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed8065db-b8df-5ef9-aaf5-ef44944f01b6', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5008f1b-51, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5008f1b-51, col_values=(('qos', UUID('8715ed5b-1ed4-47e5-9db5-1de37f5e3139')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5008f1b-51, col_values=(('external_ids', {'iface-id': 'f5008f1b-5165-4d01-823e-4d4c3fc4d5cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:4b:c0', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51')
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a7fd185-9560-56e7-b3a0-009a89bf1316', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2507f374-27, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2507f374-27, col_values=(('qos', UUID('2711aecb-85a3-41cb-86bc-dfee939e72ad')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2507f374-27, col_values=(('external_ids', {'iface-id': '2507f374-275d-4c75-8a34-64a9e36eed8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:1b:26', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27')
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c9275b1-1b2e-5129-ba2b-e49fdd22747c', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:27:13 user nova-compute[74932]: INFO nova.compute.claims [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Claim successful on node user
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f4d454e-94, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f4d454e-94, col_values=(('qos', UUID('867af6ad-05c6-4d5c-be99-42b281e3f62e')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f4d454e-94, col_values=(('external_ids', {'iface-id': '5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:7d:c2', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94')
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f9968a0-bba4-5d45-aa81-827d04ec9f72', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating resource usage from migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa20486a5-f5, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa20486a5-f5, col_values=(('qos', UUID('4e07127c-289f-4dc3-900b-310d7a4cddc4')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa20486a5-f5, col_values=(('external_ids', {'iface-id': 'a20486a5-f54d-4f05-828d-dfbc6b0cb66d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:9d:48', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5')
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2197e24f-5b0d-5b9d-849a-3bdba858bb39', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bfd246d-a0, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bfd246d-a0, col_values=(('qos', UUID('1b5a55e2-49ae-4322-9b46-59db4ce5c58f')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bfd246d-a0, col_values=(('external_ids', {'iface-id': '0bfd246d-a03a-4e06-9e68-499e2ce5c73e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:d7:de', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0')
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cc688a7-2aeb-57c3-ab11-0425cd142d90', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap348c7c87-85, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap348c7c87-85, col_values=(('qos', UUID('97ffc8f2-c35c-4cc5-9091-f3b34527c6bf')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap348c7c87-85, col_values=(('external_ids', {'iface-id': '348c7c87-85a8-41e6-a214-6170a5b2d721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:6b:ed', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85')
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7abbe0e-0edc-5262-8c1e-5cf9feba6dd1', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.545s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:14 user nova-compute[74932]: INFO nova.compute.manager [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Migrating
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: INFO nova.compute.rpcapi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61357ead-7a, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61357ead-7a, col_values=(('qos', UUID('2cafc804-1478-4846-a1f2-fa4a2298959a')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61357ead-7a, col_values=(('external_ids', {'iface-id': '61357ead-7a4e-4809-8640-dbf23410df4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:bd:49', 'vm-uuid': 'caf006bb-ea6d-4d96-a6d6-dd9cb51cd072'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:14 user nova-compute[74932]: INFO os_vif [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a')
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] No BDM found with device name hda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] No VIF found with MAC fa:16:3e:d6:4b:c0, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] No VIF found with MAC fa:16:3e:0a:d7:de, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Using config drive
Nov 03 16:27:14 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Creating config drive at /opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072/disk.config
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy477j8jv {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy477j8jv" returned: 0 in 0.054s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Starting migrate_disk_and_power_off {{(pid=74932) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-e31c6ed0-bb78-4b4b-aebb-65ccb064c04d req-f01c9d29-3151-419e-b2d9-a599e8f6911f service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e31c6ed0-bb78-4b4b-aebb-65ccb064c04d req-f01c9d29-3151-419e-b2d9-a599e8f6911f service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e31c6ed0-bb78-4b4b-aebb-65ccb064c04d req-f01c9d29-3151-419e-b2d9-a599e8f6911f service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e31c6ed0-bb78-4b4b-aebb-65ccb064c04d req-f01c9d29-3151-419e-b2d9-a599e8f6911f service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-e31c6ed0-bb78-4b4b-aebb-65ccb064c04d req-f01c9d29-3151-419e-b2d9-a599e8f6911f service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:15 user nova-compute[74932]: WARNING nova.compute.manager [req-e31c6ed0-bb78-4b4b-aebb-65ccb064c04d req-f01c9d29-3151-419e-b2d9-a599e8f6911f service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state building and task_state spawning.
Nov 03 16:27:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Instance spawned successfully.
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:15 user nova-compute[74932]: INFO nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 03 16:27:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:27:15 user nova-compute[74932]: INFO nova.compute.manager [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Took 6.76 seconds to build instance.
Nov 03 16:27:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-422a31c9-cd4e-47f2-a8d4-e1fbad374355 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.908s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance destroyed successfully.
Nov 03 16:27:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG os_vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ab56479-82, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=287a5bfc-393a-4d81-9413-c1ba0de28c9d) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: INFO os_vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82')
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:17 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.010s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[267739b0-8cc0-4e1a-8e8a-e2c48e97867e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:27:17 user nova-compute[74932]: No targets found.
Nov 03 16:27:17 user nova-compute[74932]: iSNS:
Nov 03 16:27:17 user nova-compute[74932]: No targets found.
Nov 03 16:27:17 user nova-compute[74932]: STATIC:
Nov 03 16:27:17 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0
Nov 03 16:27:17 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:27:17 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:27:17 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:27:17 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:27:17 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:27:17 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7
Nov 03 16:27:17 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:27:17 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:27:17 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:27:17 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:27:17 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:27:17 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc
Nov 03 16:27:17 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:27:17 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:27:17 user nova-compute[74932]: FIRMWARE:
Nov 03 16:27:17 user nova-compute[74932]: No targets found.
Nov 03 16:27:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:27:17 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:27:17 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894860f-4fa3-4272-a00c-a01161762143]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b680cf1d-75a9-4f1f-a76f-31e814cb6d36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:17 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8cadaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b92cc-7412-4e4f-a434-a47721c2e730]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-d693df4e-0408-4409-84c0-0f6737115bdb req-04a65270-9335-48e8-ba15-6a4e4cccf4e4 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d693df4e-0408-4409-84c0-0f6737115bdb req-04a65270-9335-48e8-ba15-6a4e4cccf4e4 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d693df4e-0408-4409-84c0-0f6737115bdb req-04a65270-9335-48e8-ba15-6a4e4cccf4e4 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d693df4e-0408-4409-84c0-0f6737115bdb req-04a65270-9335-48e8-ba15-6a4e4cccf4e4 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-d693df4e-0408-4409-84c0-0f6737115bdb req-04a65270-9335-48e8-ba15-6a4e4cccf4e4 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:17 user nova-compute[74932]: WARNING nova.compute.manager [req-d693df4e-0408-4409-84c0-0f6737115bdb req-04a65270-9335-48e8-ba15-6a4e4cccf4e4 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc for instance with vm_state building and task_state spawning.
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[103e6731-44e2-4c6f-a8ed-d7fe93c99fb7]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b199d763-212f-47e0-82af-b4da126a9774]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86269e-34fb-4432-9711-3603a64b9029]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5a9338-b495-415f-80e0-96fdface14b3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:17 user nova-compute[74932]: WARNING nova.compute.manager [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state resize_migrating.
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:17 user nova-compute[74932]: WARNING nova.compute.manager [req-637f205e-7fa2-4688-b60f-ea0e7f74c5ee req-9d170850-5dd9-4764-a85f-127b8a08c9af service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state resize_migrating.
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9b990-93b1-4942-92de-4c95d21dca1a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]
Nov 03 16:27:17 user nova-compute[74932]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a5e06-fe49-4baf-acbb-6d0477d15b3a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.474s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== disconnect_volume: return (484ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-a2103305-13e7-47c9-baf1-01c32d622bb6 req-8a519477-44dd-46ec-b212-94fdec8924f6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a2103305-13e7-47c9-baf1-01c32d622bb6 req-8a519477-44dd-46ec-b212-94fdec8924f6 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a2103305-13e7-47c9-baf1-01c32d622bb6 req-8a519477-44dd-46ec-b212-94fdec8924f6 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a2103305-13e7-47c9-baf1-01c32d622bb6 req-8a519477-44dd-46ec-b212-94fdec8924f6 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-a2103305-13e7-47c9-baf1-01c32d622bb6 req-8a519477-44dd-46ec-b212-94fdec8924f6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:17 user nova-compute[74932]: WARNING nova.compute.manager [req-a2103305-13e7-47c9-baf1-01c32d622bb6 req-8a519477-44dd-46ec-b212-94fdec8924f6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d for instance with vm_state building and task_state spawning.
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7_resize/disk /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "cp -r /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7_resize/disk /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk" returned: 0 in 0.499s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7_resize/disk.info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk.info {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "cp -r /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7_resize/disk.info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk.info" returned: 0 in 0.071s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b1d02a64-06d1-45a7-9c38-2b08ad5b2573 req-f95fcbdc-8ffe-4496-9096-da40e1b578b5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-b127467f-43b3-4bf3-b290-884211042928 req-a8d9e6b1-26a3-47b7-b47b-a2e0c66df9ce service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-c137cfc5-d52d-4ce1-bcc3-97f9dbe9bd26 req-3ab4a6d7-e56e-412f-b135-5e54e61576c1 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c137cfc5-d52d-4ce1-bcc3-97f9dbe9bd26 req-3ab4a6d7-e56e-412f-b135-5e54e61576c1 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c137cfc5-d52d-4ce1-bcc3-97f9dbe9bd26 req-3ab4a6d7-e56e-412f-b135-5e54e61576c1 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c137cfc5-d52d-4ce1-bcc3-97f9dbe9bd26 req-3ab4a6d7-e56e-412f-b135-5e54e61576c1 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-c137cfc5-d52d-4ce1-bcc3-97f9dbe9bd26 req-3ab4a6d7-e56e-412f-b135-5e54e61576c1 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:19 user nova-compute[74932]: WARNING nova.compute.manager [req-c137cfc5-d52d-4ce1-bcc3-97f9dbe9bd26 req-3ab4a6d7-e56e-412f-b135-5e54e61576c1 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d for instance with vm_state building and task_state spawning.
Nov 03 16:27:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Port 7ab56479-82d0-433f-a971-d25a3edff1ed binding to destination host user is already ACTIVE {{(pid=74932) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:20 user nova-compute[74932]: INFO nova.compute.manager [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Terminating instance
Nov 03 16:27:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Deleted allocations for instance d8e7e5d7-df88-4470-99f7-24f015dcf32a
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'numa_topology' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG nova.objects.base [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Object Instance<d8e7e5d7-df88-4470-99f7-24f015dcf32a> lazy-loaded attributes: resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:27:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Instance destroyed successfully.
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lazy-loading 'resources' on Instance uuid a354117d-a49b-4b2a-be16-8a5ca0b473b3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-721678955',display_name='tempest-VolumesAssistedSnapshotsTest-server-721678955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-721678955',id=7,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPGouILNPg3HS48sqNWiThMQ2pVUbNF5RAOLP2OlgLRsIop+mcIxVd9xINy5dXBty+9mWHLmE0mc2mTbcBd1kCPKamNBJrwQjK+uQ22q1hQDvA6GRpFKeDY2xY54oOv7g==',key_name='tempest-keypair-1947782587',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a7ccab8ee8544a1b87bbad60ed45c59',ramdisk_id='',reservation_id='r-haue4wvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-773436340',owner_user_name='tempest-VolumesAssistedSnapshotsTest-773436340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e0b38596a4d402a9a37f538a09d8a5e',uuid=a354117d-a49b-4b2a-be16-8a5ca0b473b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Converting VIF {"id": "ca947369-6fd5-4679-a73a-898d1acfe51b", "address": "fa:16:3e:7f:07:b3", "network": {"id": "bedd9ad4-0bd8-4436-afee-edfe57338669", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-372656561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a7ccab8ee8544a1b87bbad60ed45c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca947369-6f", "ovs_interfaceid": "ca947369-6fd5-4679-a73a-898d1acfe51b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_vif [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca947369-6f, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:21 user nova-compute[74932]: WARNING nova.compute.manager [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 for instance with vm_state building and task_state spawning.
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-vif-unplugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] No waiting events found dispatching network-vif-unplugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-74d34fe9-a6a2-4c4d-bea7-7a09d937c823 req-10b2ede6-7e27-4a3d-aa23-d409b4bc1834 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-vif-unplugged-ca947369-6fd5-4679-a73a-898d1acfe51b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfa2dfe3-481c-4240-9d0c-27df6a7e1d6e) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: INFO os_vif [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:07:b3,bridge_name='br-int',has_traffic_filtering=True,id=ca947369-6fd5-4679-a73a-898d1acfe51b,network=Network(bedd9ad4-0bd8-4436-afee-edfe57338669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca947369-6f')
Nov 03 16:27:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Deleting instance files /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3_del
Nov 03 16:27:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Deletion of /opt/stack/data/nova/instances/a354117d-a49b-4b2a-be16-8a5ca0b473b3_del complete
Nov 03 16:27:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-1645da00-2dd4-49fa-98bb-b5544fe33a41 req-b0b55a06-7eca-4d68-964b-e63ad8273e16 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1645da00-2dd4-49fa-98bb-b5544fe33a41 req-b0b55a06-7eca-4d68-964b-e63ad8273e16 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1645da00-2dd4-49fa-98bb-b5544fe33a41 req-b0b55a06-7eca-4d68-964b-e63ad8273e16 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1645da00-2dd4-49fa-98bb-b5544fe33a41 req-b0b55a06-7eca-4d68-964b-e63ad8273e16 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-1645da00-2dd4-49fa-98bb-b5544fe33a41 req-b0b55a06-7eca-4d68-964b-e63ad8273e16 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:21 user nova-compute[74932]: WARNING nova.compute.manager [req-1645da00-2dd4-49fa-98bb-b5544fe33a41 req-b0b55a06-7eca-4d68-964b-e63ad8273e16 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f for instance with vm_state building and task_state spawning.
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.757s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:21 user nova-compute[74932]: INFO nova.compute.manager [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_brick.utils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b38c19-65bc-4242-894a-7c87b0ded52e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a292479a-54eb-4d13-87ea-e2c85a9ea943 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 27.897s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7407721-6749-45a8-bdef-b87058d57af4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a79866-1108-49e7-9a65-166cb0a4b7e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6d33e6-fdea-4c00-9a7c-02cdf033ae71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:27:21 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:27:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fcb057-c32c-4d37-b275-b8b18154b013]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:27:21 user nova-compute[74932]: DEBUG os_brick.utils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:27:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance spawned successfully.
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:22 user nova-compute[74932]: INFO nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Took 14.62 seconds to spawn the instance on the hypervisor.
Nov 03 16:27:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:27:22 user nova-compute[74932]: INFO nova.compute.manager [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Took 109.86 seconds to build instance.
Nov 03 16:27:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7515b4fa-672c-41e5-8914-57b6b28ae68b tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 109.957s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:23 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Took 1.36 seconds to deallocate network for instance.
Nov 03 16:27:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] Acquiring lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] No waiting events found dispatching network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:23 user nova-compute[74932]: WARNING nova.compute.manager [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received unexpected event network-vif-plugged-ca947369-6fd5-4679-a73a-898d1acfe51b for instance with vm_state deleted and task_state None.
Nov 03 16:27:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-8a907bdf-6a41-4d40-9577-233d62c113ed req-130b76dd-e07e-48b3-9097-f0c35ba399e0 service nova] [instance: a354117d-a49b-4b2a-be16-8a5ca0b473b3] Received event network-vif-deleted-ca947369-6fd5-4679-a73a-898d1acfe51b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:23 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Deleted allocations for instance a354117d-a49b-4b2a-be16-8a5ca0b473b3
Nov 03 16:27:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5f6a261-d5cb-4a06-8781-391522a2488e tempest-VolumesAssistedSnapshotsTest-773436340 tempest-VolumesAssistedSnapshotsTest-773436340-project-member] Lock "a354117d-a49b-4b2a-be16-8a5ca0b473b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.535s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:25 user nova-compute[74932]: WARNING nova.compute.manager [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Timeout waiting for ['volume-reimaged-cf741834-ac61-45fe-aeb4-a9251302df16'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-cf741834-ac61-45fe-aeb4-a9251302df16: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 03 16:27:25 user nova-compute[74932]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7fdc84338520 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 03 16:27:25 user nova-compute[74932]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 03 16:27:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:25 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:25 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:25 user nova-compute[74932]: INFO nova.compute.manager [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Successfully reverted task state from rebuilding on failure for instance.
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server [None req-39db8acc-e3e7-4bed-badc-d5f192e27e24 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 03 16:27:25 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:27:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:27 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Waiting for libvirt event about the detach of device tapa4413064-96 with device alias net1 from instance 318067b8-c589-4008-b154-5220a87e598e is timed out.
Nov 03 16:27:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface> {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 16:27:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 03 16:27:27 user nova-compute[74932]:   <name>instance-00000008</name>
Nov 03 16:27:27 user nova-compute[74932]:   <uuid>318067b8-c589-4008-b154-5220a87e598e</uuid>
Nov 03 16:27:27 user nova-compute[74932]:   <metadata>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:27 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:27:27 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:27:27 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:25:55</nova:creationTime>
Nov 03 16:27:27 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:27:27 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:27 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:27:27 user nova-compute[74932]:   <nova:owner>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:27:27 user nova-compute[74932]:   </nova:owner>
Nov 03 16:27:27 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:27 user nova-compute[74932]:   <nova:ports>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:27:27 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:27:27 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:27 user nova-compute[74932]:     <nova:port uuid="a4413064-969d-4c4c-8559-48c43de58f8b">
Nov 03 16:27:27 user nova-compute[74932]:       <nova:ip type="fixed" address="10.10.10.249" ipVersion="4"/>
Nov 03 16:27:27 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:27 user nova-compute[74932]:   </nova:ports>
Nov 03 16:27:27 user nova-compute[74932]: </nova:instance>
Nov 03 16:27:27 user nova-compute[74932]:   </metadata>
Nov 03 16:27:27 user nova-compute[74932]:   <memory unit='KiB'>524288</memory>
Nov 03 16:27:27 user nova-compute[74932]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 16:27:27 user nova-compute[74932]:   <vcpu placement='static'>1</vcpu>
Nov 03 16:27:27 user nova-compute[74932]:   <resource>
Nov 03 16:27:27 user nova-compute[74932]:     <partition>/machine</partition>
Nov 03 16:27:27 user nova-compute[74932]:   </resource>
Nov 03 16:27:27 user nova-compute[74932]:   <sysinfo type='smbios'>
Nov 03 16:27:27 user nova-compute[74932]:     <system>
Nov 03 16:27:27 user nova-compute[74932]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 16:27:27 user nova-compute[74932]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 16:27:27 user nova-compute[74932]:       <entry name='version'>0.0.0</entry>
Nov 03 16:27:27 user nova-compute[74932]:       <entry name='serial'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:27 user nova-compute[74932]:       <entry name='uuid'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:27 user nova-compute[74932]:       <entry name='family'>Virtual Machine</entry>
Nov 03 16:27:27 user nova-compute[74932]:     </system>
Nov 03 16:27:27 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:27 user nova-compute[74932]:   <os>
Nov 03 16:27:27 user nova-compute[74932]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 16:27:27 user nova-compute[74932]:     <boot dev='hd'/>
Nov 03 16:27:27 user nova-compute[74932]:     <smbios mode='sysinfo'/>
Nov 03 16:27:27 user nova-compute[74932]:   </os>
Nov 03 16:27:27 user nova-compute[74932]:   <features>
Nov 03 16:27:27 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:27 user nova-compute[74932]:     <apic/>
Nov 03 16:27:27 user nova-compute[74932]:     <vmcoreinfo state='on'/>
Nov 03 16:27:27 user nova-compute[74932]:   </features>
Nov 03 16:27:27 user nova-compute[74932]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 16:27:27 user nova-compute[74932]:     <model fallback='forbid'>Nehalem</model>
Nov 03 16:27:27 user nova-compute[74932]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 16:27:27 user nova-compute[74932]:     <feature policy='require' name='vme'/>
Nov 03 16:27:27 user nova-compute[74932]:     <feature policy='require' name='x2apic'/>
Nov 03 16:27:27 user nova-compute[74932]:     <feature policy='require' name='hypervisor'/>
Nov 03 16:27:27 user nova-compute[74932]:   </cpu>
Nov 03 16:27:27 user nova-compute[74932]:   <clock offset='utc'>
Nov 03 16:27:27 user nova-compute[74932]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 16:27:27 user nova-compute[74932]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 16:27:27 user nova-compute[74932]:     <timer name='hpet' present='no'/>
Nov 03 16:27:27 user nova-compute[74932]:   </clock>
Nov 03 16:27:27 user nova-compute[74932]:   <on_poweroff>destroy</on_poweroff>
Nov 03 16:27:27 user nova-compute[74932]:   <on_reboot>restart</on_reboot>
Nov 03 16:27:27 user nova-compute[74932]:   <on_crash>destroy</on_crash>
Nov 03 16:27:27 user nova-compute[74932]:   <devices>
Nov 03 16:27:27 user nova-compute[74932]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 16:27:27 user nova-compute[74932]:     <disk type='file' device='disk'>
Nov 03 16:27:27 user nova-compute[74932]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 16:27:27 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk' index='2'/>
Nov 03 16:27:27 user nova-compute[74932]:       <backingStore type='file' index='3'>
Nov 03 16:27:27 user nova-compute[74932]:         <format type='raw'/>
Nov 03 16:27:27 user nova-compute[74932]:         <source file='/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2'/>
Nov 03 16:27:27 user nova-compute[74932]:         <backingStore/>
Nov 03 16:27:27 user nova-compute[74932]:       </backingStore>
Nov 03 16:27:27 user nova-compute[74932]:       <target dev='vda' bus='virtio'/>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='virtio-disk0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </disk>
Nov 03 16:27:27 user nova-compute[74932]:     <disk type='file' device='cdrom'>
Nov 03 16:27:27 user nova-compute[74932]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 16:27:27 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config' index='1'/>
Nov 03 16:27:27 user nova-compute[74932]:       <backingStore/>
Nov 03 16:27:27 user nova-compute[74932]:       <target dev='hda' bus='ide'/>
Nov 03 16:27:27 user nova-compute[74932]:       <readonly/>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='ide0-0-0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </disk>
Nov 03 16:27:27 user nova-compute[74932]:     <controller type='usb' index='0' model='none'>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='usb'/>
Nov 03 16:27:27 user nova-compute[74932]:     </controller>
Nov 03 16:27:27 user nova-compute[74932]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='pci.0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </controller>
Nov 03 16:27:27 user nova-compute[74932]:     <controller type='ide' index='0'>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='ide'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 16:27:27 user nova-compute[74932]:     </controller>
Nov 03 16:27:27 user nova-compute[74932]:     <interface type='ethernet'>
Nov 03 16:27:27 user nova-compute[74932]:       <mac address='fa:16:3e:f8:5a:db'/>
Nov 03 16:27:27 user nova-compute[74932]:       <target dev='tap9ca44a20-17'/>
Nov 03 16:27:27 user nova-compute[74932]:       <model type='virtio'/>
Nov 03 16:27:27 user nova-compute[74932]:       <mtu size='1442'/>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='net0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </interface>
Nov 03 16:27:27 user nova-compute[74932]:     <serial type='pty'>
Nov 03 16:27:27 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:27 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:27 user nova-compute[74932]:       <target type='isa-serial' port='0'>
Nov 03 16:27:27 user nova-compute[74932]:         <model name='isa-serial'/>
Nov 03 16:27:27 user nova-compute[74932]:       </target>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </serial>
Nov 03 16:27:27 user nova-compute[74932]:     <console type='pty' tty='/dev/pts/7'>
Nov 03 16:27:27 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:27 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:27 user nova-compute[74932]:       <target type='serial' port='0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </console>
Nov 03 16:27:27 user nova-compute[74932]:     <input type='mouse' bus='ps2'>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='input0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </input>
Nov 03 16:27:27 user nova-compute[74932]:     <input type='keyboard' bus='ps2'>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='input1'/>
Nov 03 16:27:27 user nova-compute[74932]:     </input>
Nov 03 16:27:27 user nova-compute[74932]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 03 16:27:27 user nova-compute[74932]:       <listen type='address' address='0.0.0.0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </graphics>
Nov 03 16:27:27 user nova-compute[74932]:     <audio id='1' type='none'/>
Nov 03 16:27:27 user nova-compute[74932]:     <video>
Nov 03 16:27:27 user nova-compute[74932]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='video0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </video>
Nov 03 16:27:27 user nova-compute[74932]:     <memballoon model='virtio'>
Nov 03 16:27:27 user nova-compute[74932]:       <stats period='10'/>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='balloon0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:27 user nova-compute[74932]:     <rng model='virtio'>
Nov 03 16:27:27 user nova-compute[74932]:       <backend model='random'>/dev/urandom</backend>
Nov 03 16:27:27 user nova-compute[74932]:       <alias name='rng0'/>
Nov 03 16:27:27 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 16:27:27 user nova-compute[74932]:     </rng>
Nov 03 16:27:27 user nova-compute[74932]:   </devices>
Nov 03 16:27:27 user nova-compute[74932]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 16:27:27 user nova-compute[74932]:     <label>libvirt-318067b8-c589-4008-b154-5220a87e598e</label>
Nov 03 16:27:27 user nova-compute[74932]:     <imagelabel>libvirt-318067b8-c589-4008-b154-5220a87e598e</imagelabel>
Nov 03 16:27:27 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:27 user nova-compute[74932]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 16:27:27 user nova-compute[74932]:     <label>+64055:+108</label>
Nov 03 16:27:27 user nova-compute[74932]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 16:27:27 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:27 user nova-compute[74932]: </domain>
Nov 03 16:27:27 user nova-compute[74932]:  {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 16:27:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully detached device tapa4413064-96 from instance 318067b8-c589-4008-b154-5220a87e598e from the live domain config.
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG os_vif [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4413064-96, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07b18974-9c16-4b99-82c7-0e1e9594109c) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: INFO os_vif [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96')
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:28 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:27:28</nova:creationTime>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:27:28 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:ports>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:27:28 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:27:28 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:ports>
Nov 03 16:27:28 user nova-compute[74932]: </nova:instance>
Nov 03 16:27:28 user nova-compute[74932]:  {{(pid=74932) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.compute.manager [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-deleted-a4413064-969d-4c4c-8559-48c43de58f8b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:28 user nova-compute[74932]: INFO nova.compute.manager [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Neutron deleted interface a4413064-969d-4c4c-8559-48c43de58f8b; detaching it from the instance and deleting it from the info cache
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.neutron [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquired lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.objects.instance [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Lazy-loading 'system_metadata' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.objects.instance [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Lazy-loading 'flavor' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.objects.base [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Object Instance<318067b8-c589-4008-b154-5220a87e598e> lazy-loaded attributes: system_metadata,flavor {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Converting VIF {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface> {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 03 16:27:28 user nova-compute[74932]:   <name>instance-00000008</name>
Nov 03 16:27:28 user nova-compute[74932]:   <uuid>318067b8-c589-4008-b154-5220a87e598e</uuid>
Nov 03 16:27:28 user nova-compute[74932]:   <metadata>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:28 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:27:28</nova:creationTime>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:27:28 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:ports>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:27:28 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:27:28 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:ports>
Nov 03 16:27:28 user nova-compute[74932]: </nova:instance>
Nov 03 16:27:28 user nova-compute[74932]:   </metadata>
Nov 03 16:27:28 user nova-compute[74932]:   <memory unit='KiB'>524288</memory>
Nov 03 16:27:28 user nova-compute[74932]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 16:27:28 user nova-compute[74932]:   <vcpu placement='static'>1</vcpu>
Nov 03 16:27:28 user nova-compute[74932]:   <resource>
Nov 03 16:27:28 user nova-compute[74932]:     <partition>/machine</partition>
Nov 03 16:27:28 user nova-compute[74932]:   </resource>
Nov 03 16:27:28 user nova-compute[74932]:   <sysinfo type='smbios'>
Nov 03 16:27:28 user nova-compute[74932]:     <system>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='version'>0.0.0</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='serial'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='uuid'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='family'>Virtual Machine</entry>
Nov 03 16:27:28 user nova-compute[74932]:     </system>
Nov 03 16:27:28 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:28 user nova-compute[74932]:   <os>
Nov 03 16:27:28 user nova-compute[74932]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 16:27:28 user nova-compute[74932]:     <boot dev='hd'/>
Nov 03 16:27:28 user nova-compute[74932]:     <smbios mode='sysinfo'/>
Nov 03 16:27:28 user nova-compute[74932]:   </os>
Nov 03 16:27:28 user nova-compute[74932]:   <features>
Nov 03 16:27:28 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:28 user nova-compute[74932]:     <apic/>
Nov 03 16:27:28 user nova-compute[74932]:     <vmcoreinfo state='on'/>
Nov 03 16:27:28 user nova-compute[74932]:   </features>
Nov 03 16:27:28 user nova-compute[74932]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 16:27:28 user nova-compute[74932]:     <model fallback='forbid'>Nehalem</model>
Nov 03 16:27:28 user nova-compute[74932]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 16:27:28 user nova-compute[74932]:     <feature policy='require' name='vme'/>
Nov 03 16:27:28 user nova-compute[74932]:     <feature policy='require' name='x2apic'/>
Nov 03 16:27:28 user nova-compute[74932]:     <feature policy='require' name='hypervisor'/>
Nov 03 16:27:28 user nova-compute[74932]:   </cpu>
Nov 03 16:27:28 user nova-compute[74932]:   <clock offset='utc'>
Nov 03 16:27:28 user nova-compute[74932]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 16:27:28 user nova-compute[74932]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 16:27:28 user nova-compute[74932]:     <timer name='hpet' present='no'/>
Nov 03 16:27:28 user nova-compute[74932]:   </clock>
Nov 03 16:27:28 user nova-compute[74932]:   <on_poweroff>destroy</on_poweroff>
Nov 03 16:27:28 user nova-compute[74932]:   <on_reboot>restart</on_reboot>
Nov 03 16:27:28 user nova-compute[74932]:   <on_crash>destroy</on_crash>
Nov 03 16:27:28 user nova-compute[74932]:   <devices>
Nov 03 16:27:28 user nova-compute[74932]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 16:27:28 user nova-compute[74932]:     <disk type='file' device='disk'>
Nov 03 16:27:28 user nova-compute[74932]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 16:27:28 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk' index='2'/>
Nov 03 16:27:28 user nova-compute[74932]:       <backingStore type='file' index='3'>
Nov 03 16:27:28 user nova-compute[74932]:         <format type='raw'/>
Nov 03 16:27:28 user nova-compute[74932]:         <source file='/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2'/>
Nov 03 16:27:28 user nova-compute[74932]:         <backingStore/>
Nov 03 16:27:28 user nova-compute[74932]:       </backingStore>
Nov 03 16:27:28 user nova-compute[74932]:       <target dev='vda' bus='virtio'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='virtio-disk0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </disk>
Nov 03 16:27:28 user nova-compute[74932]:     <disk type='file' device='cdrom'>
Nov 03 16:27:28 user nova-compute[74932]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 16:27:28 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config' index='1'/>
Nov 03 16:27:28 user nova-compute[74932]:       <backingStore/>
Nov 03 16:27:28 user nova-compute[74932]:       <target dev='hda' bus='ide'/>
Nov 03 16:27:28 user nova-compute[74932]:       <readonly/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='ide0-0-0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </disk>
Nov 03 16:27:28 user nova-compute[74932]:     <controller type='usb' index='0' model='none'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='usb'/>
Nov 03 16:27:28 user nova-compute[74932]:     </controller>
Nov 03 16:27:28 user nova-compute[74932]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='pci.0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </controller>
Nov 03 16:27:28 user nova-compute[74932]:     <controller type='ide' index='0'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='ide'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 16:27:28 user nova-compute[74932]:     </controller>
Nov 03 16:27:28 user nova-compute[74932]:     <interface type='ethernet'>
Nov 03 16:27:28 user nova-compute[74932]:       <mac address='fa:16:3e:f8:5a:db'/>
Nov 03 16:27:28 user nova-compute[74932]:       <target dev='tap9ca44a20-17'/>
Nov 03 16:27:28 user nova-compute[74932]:       <model type='virtio'/>
Nov 03 16:27:28 user nova-compute[74932]:       <mtu size='1442'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='net0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </interface>
Nov 03 16:27:28 user nova-compute[74932]:     <serial type='pty'>
Nov 03 16:27:28 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:28 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:28 user nova-compute[74932]:       <target type='isa-serial' port='0'>
Nov 03 16:27:28 user nova-compute[74932]:         <model name='isa-serial'/>
Nov 03 16:27:28 user nova-compute[74932]:       </target>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </serial>
Nov 03 16:27:28 user nova-compute[74932]:     <console type='pty' tty='/dev/pts/7'>
Nov 03 16:27:28 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:28 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:28 user nova-compute[74932]:       <target type='serial' port='0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </console>
Nov 03 16:27:28 user nova-compute[74932]:     <input type='mouse' bus='ps2'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='input0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </input>
Nov 03 16:27:28 user nova-compute[74932]:     <input type='keyboard' bus='ps2'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='input1'/>
Nov 03 16:27:28 user nova-compute[74932]:     </input>
Nov 03 16:27:28 user nova-compute[74932]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 03 16:27:28 user nova-compute[74932]:       <listen type='address' address='0.0.0.0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </graphics>
Nov 03 16:27:28 user nova-compute[74932]:     <audio id='1' type='none'/>
Nov 03 16:27:28 user nova-compute[74932]:     <video>
Nov 03 16:27:28 user nova-compute[74932]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='video0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </video>
Nov 03 16:27:28 user nova-compute[74932]:     <memballoon model='virtio'>
Nov 03 16:27:28 user nova-compute[74932]:       <stats period='10'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='balloon0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:28 user nova-compute[74932]:     <rng model='virtio'>
Nov 03 16:27:28 user nova-compute[74932]:       <backend model='random'>/dev/urandom</backend>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='rng0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </rng>
Nov 03 16:27:28 user nova-compute[74932]:   </devices>
Nov 03 16:27:28 user nova-compute[74932]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 16:27:28 user nova-compute[74932]:     <label>libvirt-318067b8-c589-4008-b154-5220a87e598e</label>
Nov 03 16:27:28 user nova-compute[74932]:     <imagelabel>libvirt-318067b8-c589-4008-b154-5220a87e598e</imagelabel>
Nov 03 16:27:28 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:28 user nova-compute[74932]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 16:27:28 user nova-compute[74932]:     <label>+64055:+108</label>
Nov 03 16:27:28 user nova-compute[74932]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 16:27:28 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:28 user nova-compute[74932]: </domain>
Nov 03 16:27:28 user nova-compute[74932]:  {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface> {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cf:41:70"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4413064-96"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 03 16:27:28 user nova-compute[74932]:   <name>instance-00000008</name>
Nov 03 16:27:28 user nova-compute[74932]:   <uuid>318067b8-c589-4008-b154-5220a87e598e</uuid>
Nov 03 16:27:28 user nova-compute[74932]:   <metadata>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:28 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:27:28</nova:creationTime>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:27:28 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:ports>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:27:28 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:27:28 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:ports>
Nov 03 16:27:28 user nova-compute[74932]: </nova:instance>
Nov 03 16:27:28 user nova-compute[74932]:   </metadata>
Nov 03 16:27:28 user nova-compute[74932]:   <memory unit='KiB'>524288</memory>
Nov 03 16:27:28 user nova-compute[74932]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 16:27:28 user nova-compute[74932]:   <vcpu placement='static'>1</vcpu>
Nov 03 16:27:28 user nova-compute[74932]:   <resource>
Nov 03 16:27:28 user nova-compute[74932]:     <partition>/machine</partition>
Nov 03 16:27:28 user nova-compute[74932]:   </resource>
Nov 03 16:27:28 user nova-compute[74932]:   <sysinfo type='smbios'>
Nov 03 16:27:28 user nova-compute[74932]:     <system>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='version'>0.0.0</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='serial'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='uuid'>318067b8-c589-4008-b154-5220a87e598e</entry>
Nov 03 16:27:28 user nova-compute[74932]:       <entry name='family'>Virtual Machine</entry>
Nov 03 16:27:28 user nova-compute[74932]:     </system>
Nov 03 16:27:28 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:28 user nova-compute[74932]:   <os>
Nov 03 16:27:28 user nova-compute[74932]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 16:27:28 user nova-compute[74932]:     <boot dev='hd'/>
Nov 03 16:27:28 user nova-compute[74932]:     <smbios mode='sysinfo'/>
Nov 03 16:27:28 user nova-compute[74932]:   </os>
Nov 03 16:27:28 user nova-compute[74932]:   <features>
Nov 03 16:27:28 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:28 user nova-compute[74932]:     <apic/>
Nov 03 16:27:28 user nova-compute[74932]:     <vmcoreinfo state='on'/>
Nov 03 16:27:28 user nova-compute[74932]:   </features>
Nov 03 16:27:28 user nova-compute[74932]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 16:27:28 user nova-compute[74932]:     <model fallback='forbid'>Nehalem</model>
Nov 03 16:27:28 user nova-compute[74932]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 16:27:28 user nova-compute[74932]:     <feature policy='require' name='vme'/>
Nov 03 16:27:28 user nova-compute[74932]:     <feature policy='require' name='x2apic'/>
Nov 03 16:27:28 user nova-compute[74932]:     <feature policy='require' name='hypervisor'/>
Nov 03 16:27:28 user nova-compute[74932]:   </cpu>
Nov 03 16:27:28 user nova-compute[74932]:   <clock offset='utc'>
Nov 03 16:27:28 user nova-compute[74932]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 16:27:28 user nova-compute[74932]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 16:27:28 user nova-compute[74932]:     <timer name='hpet' present='no'/>
Nov 03 16:27:28 user nova-compute[74932]:   </clock>
Nov 03 16:27:28 user nova-compute[74932]:   <on_poweroff>destroy</on_poweroff>
Nov 03 16:27:28 user nova-compute[74932]:   <on_reboot>restart</on_reboot>
Nov 03 16:27:28 user nova-compute[74932]:   <on_crash>destroy</on_crash>
Nov 03 16:27:28 user nova-compute[74932]:   <devices>
Nov 03 16:27:28 user nova-compute[74932]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 16:27:28 user nova-compute[74932]:     <disk type='file' device='disk'>
Nov 03 16:27:28 user nova-compute[74932]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 16:27:28 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk' index='2'/>
Nov 03 16:27:28 user nova-compute[74932]:       <backingStore type='file' index='3'>
Nov 03 16:27:28 user nova-compute[74932]:         <format type='raw'/>
Nov 03 16:27:28 user nova-compute[74932]:         <source file='/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2'/>
Nov 03 16:27:28 user nova-compute[74932]:         <backingStore/>
Nov 03 16:27:28 user nova-compute[74932]:       </backingStore>
Nov 03 16:27:28 user nova-compute[74932]:       <target dev='vda' bus='virtio'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='virtio-disk0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </disk>
Nov 03 16:27:28 user nova-compute[74932]:     <disk type='file' device='cdrom'>
Nov 03 16:27:28 user nova-compute[74932]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 16:27:28 user nova-compute[74932]:       <source file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk.config' index='1'/>
Nov 03 16:27:28 user nova-compute[74932]:       <backingStore/>
Nov 03 16:27:28 user nova-compute[74932]:       <target dev='hda' bus='ide'/>
Nov 03 16:27:28 user nova-compute[74932]:       <readonly/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='ide0-0-0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </disk>
Nov 03 16:27:28 user nova-compute[74932]:     <controller type='usb' index='0' model='none'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='usb'/>
Nov 03 16:27:28 user nova-compute[74932]:     </controller>
Nov 03 16:27:28 user nova-compute[74932]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='pci.0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </controller>
Nov 03 16:27:28 user nova-compute[74932]:     <controller type='ide' index='0'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='ide'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 16:27:28 user nova-compute[74932]:     </controller>
Nov 03 16:27:28 user nova-compute[74932]:     <interface type='ethernet'>
Nov 03 16:27:28 user nova-compute[74932]:       <mac address='fa:16:3e:f8:5a:db'/>
Nov 03 16:27:28 user nova-compute[74932]:       <target dev='tap9ca44a20-17'/>
Nov 03 16:27:28 user nova-compute[74932]:       <model type='virtio'/>
Nov 03 16:27:28 user nova-compute[74932]:       <mtu size='1442'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='net0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </interface>
Nov 03 16:27:28 user nova-compute[74932]:     <serial type='pty'>
Nov 03 16:27:28 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:28 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:28 user nova-compute[74932]:       <target type='isa-serial' port='0'>
Nov 03 16:27:28 user nova-compute[74932]:         <model name='isa-serial'/>
Nov 03 16:27:28 user nova-compute[74932]:       </target>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </serial>
Nov 03 16:27:28 user nova-compute[74932]:     <console type='pty' tty='/dev/pts/7'>
Nov 03 16:27:28 user nova-compute[74932]:       <source path='/dev/pts/7'/>
Nov 03 16:27:28 user nova-compute[74932]:       <log file='/opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/console.log' append='off'/>
Nov 03 16:27:28 user nova-compute[74932]:       <target type='serial' port='0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='serial0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </console>
Nov 03 16:27:28 user nova-compute[74932]:     <input type='mouse' bus='ps2'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='input0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </input>
Nov 03 16:27:28 user nova-compute[74932]:     <input type='keyboard' bus='ps2'>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='input1'/>
Nov 03 16:27:28 user nova-compute[74932]:     </input>
Nov 03 16:27:28 user nova-compute[74932]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 03 16:27:28 user nova-compute[74932]:       <listen type='address' address='0.0.0.0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </graphics>
Nov 03 16:27:28 user nova-compute[74932]:     <audio id='1' type='none'/>
Nov 03 16:27:28 user nova-compute[74932]:     <video>
Nov 03 16:27:28 user nova-compute[74932]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='video0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </video>
Nov 03 16:27:28 user nova-compute[74932]:     <memballoon model='virtio'>
Nov 03 16:27:28 user nova-compute[74932]:       <stats period='10'/>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='balloon0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:28 user nova-compute[74932]:     <rng model='virtio'>
Nov 03 16:27:28 user nova-compute[74932]:       <backend model='random'>/dev/urandom</backend>
Nov 03 16:27:28 user nova-compute[74932]:       <alias name='rng0'/>
Nov 03 16:27:28 user nova-compute[74932]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 16:27:28 user nova-compute[74932]:     </rng>
Nov 03 16:27:28 user nova-compute[74932]:   </devices>
Nov 03 16:27:28 user nova-compute[74932]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 16:27:28 user nova-compute[74932]:     <label>libvirt-318067b8-c589-4008-b154-5220a87e598e</label>
Nov 03 16:27:28 user nova-compute[74932]:     <imagelabel>libvirt-318067b8-c589-4008-b154-5220a87e598e</imagelabel>
Nov 03 16:27:28 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:28 user nova-compute[74932]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 16:27:28 user nova-compute[74932]:     <label>+64055:+108</label>
Nov 03 16:27:28 user nova-compute[74932]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 16:27:28 user nova-compute[74932]:   </seclabel>
Nov 03 16:27:28 user nova-compute[74932]: </domain>
Nov 03 16:27:28 user nova-compute[74932]:  {{(pid=74932) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 16:27:28 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Detaching interface fa:16:3e:cf:41:70 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa4413064-96' not found.
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Converting VIF {"id": "a4413064-969d-4c4c-8559-48c43de58f8b", "address": "fa:16:3e:cf:41:70", "network": {"id": "3249335b-c707-49e5-a9df-5a66ba2b0b3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1317192045", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4413064-96", "ovs_interfaceid": "a4413064-969d-4c4c-8559-48c43de58f8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG os_vif [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4413064-96, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:28 user nova-compute[74932]: INFO os_vif [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:41:70,bridge_name='br-int',has_traffic_filtering=True,id=a4413064-969d-4c4c-8559-48c43de58f8b,network=Network(3249335b-c707-49e5-a9df-5a66ba2b0b3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4413064-96')
Nov 03 16:27:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [req-142536af-1428-422f-be33-dfc4295541b8 req-7ae86233-669e-4c7f-a30b-bb62ceaf7652 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:28 user nova-compute[74932]:   <nova:package version="0.0.0"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:name>tempest-device-tagging-server-1888885135</nova:name>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:creationTime>2023-11-03 16:27:28</nova:creationTime>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:flavor name="m1.tiny">
Nov 03 16:27:28 user nova-compute[74932]:     <nova:memory>512</nova:memory>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:disk>1</nova:disk>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:swap>0</nova:swap>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:flavor>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:user uuid="fba5285c331f4fe2a170ed8623aed9c9">tempest-TaggedAttachmentsTest-518552287-project-member</nova:user>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:project uuid="637cbdeb134a457cb9652bf70048083a">tempest-TaggedAttachmentsTest-518552287</nova:project>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:owner>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:28 user nova-compute[74932]:   <nova:ports>
Nov 03 16:27:28 user nova-compute[74932]:     <nova:port uuid="9ca44a20-177b-4dd1-9d6c-f752f5127ca3">
Nov 03 16:27:28 user nova-compute[74932]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:27:28 user nova-compute[74932]:     </nova:port>
Nov 03 16:27:28 user nova-compute[74932]:   </nova:ports>
Nov 03 16:27:28 user nova-compute[74932]: </nova:instance>
Nov 03 16:27:28 user nova-compute[74932]:  {{(pid=74932) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 16:27:29 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [{"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Releasing lock "refresh_cache-318067b8-c589-4008-b154-5220a87e598e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a099df31-3149-4ba4-af7e-dbe766b6b1a4 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "interface-318067b8-c589-4008-b154-5220a87e598e-a4413064-969d-4c4c-8559-48c43de58f8b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.825s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'pci_requests' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'numa_topology' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:27:33 user nova-compute[74932]: INFO nova.compute.claims [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Claim successful on node user
Nov 03 16:27:33 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:33 user nova-compute[74932]: INFO nova.network.neutron [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 16:27:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:34 user nova-compute[74932]: DEBUG nova.network.neutron [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:27:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing instance network info cache due to event network-changed-7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:27:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] Acquiring lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG nova.network.neutron [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:27:35 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Creating image(s)
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG nova.objects.instance [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] Acquired lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG nova.network.neutron [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Refreshing network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG nova.objects.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<0238b778-b9e2-4a5b-82f2-5d58a6a552e7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "423b51467087ab11ed9c1766d965e5927aa4894f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "423b51467087ab11ed9c1766d965e5927aa4894f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG nova.virt.images [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] dda83f43-ba9e-4f18-ad55-d343e16fee5b was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.part /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG nova.network.neutron [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updated VIF entry in instance network info cache for port 7d0caef5-f058-4eca-b838-2cf6bf7cae2d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG nova.network.neutron [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-282d4671-052e-4290-a4fa-cce4d9c3755a req-4ac2f592-f057-41fe-9e12-6d0baae350dc service nova] Releasing lock "refresh_cache-0238b778-b9e2-4a5b-82f2-5d58a6a552e7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.part /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.converted" returned: 0 in 0.506s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "423b51467087ab11ed9c1766d965e5927aa4894f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.056s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "423b51467087ab11ed9c1766d965e5927aa4894f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "423b51467087ab11ed9c1766d965e5927aa4894f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f,backing_fmt=raw /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f,backing_fmt=raw /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk 1073741824" returned: 0 in 0.056s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "423b51467087ab11ed9c1766d965e5927aa4894f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/423b51467087ab11ed9c1766d965e5927aa4894f --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG nova.objects.instance [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'migration_context' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:37 user nova-compute[74932]: DEBUG nova.objects.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<0238b778-b9e2-4a5b-82f2-5d58a6a552e7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:27:37 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Rebasing disk image.
Nov 03 16:27:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 -F raw /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 -F raw /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk" returned: 0 in 2.976s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Ensure instance console log exists: /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Start _get_guest_xml network_info=[{"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4edaf8e8eca47467caac5f0f9d8f99ea',container_format='bare',created_at=2023-11-03T16:24:57Z,direct_url=<?>,disk_format='qcow2',id=dda83f43-ba9e-4f18-ad55-d343e16fee5b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1869007814-shelved',owner='b101d0f7f99a41f699e3f2701cc35248',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T16:25:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geGLqxsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0238b778-b9e2-4a5b-82f2-5d58a6a552e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c49daba7-6951-4cac-9b1d-bafe28733fd8', 'serial': 'c49daba7-6951-4cac-9b1d-bafe28733fd8'}, 'attachment_id': '2e53e13f-829a-4cd8-909b-e0d13f2fcd75', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:27:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4edaf8e8eca47467caac5f0f9d8f99ea',container_format='bare',created_at=2023-11-03T16:24:57Z,direct_url=<?>,disk_format='qcow2',id=dda83f43-ba9e-4f18-ad55-d343e16fee5b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1869007814-shelved',owner='b101d0f7f99a41f699e3f2701cc35248',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T16:25:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.objects.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<0238b778-b9e2-4a5b-82f2-5d58a6a552e7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geGLqxsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:41 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:41 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:41 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260" returned: 21 in 0.069s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[43523aaa-c312-4c70-a310-aabc0a613bf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:27:41 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[42123826-e0b7-4737-9f63-2513ba7bfc86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8] added
Nov 03 16:27:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda867bd-0110-46e1-91c1-03cf5eb76a4a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8bf6c9-a1da-415d-b98d-e382b6ef90c8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geGLqxsv {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geGLqxsv" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bff59e-f717-45d2-843a-7363dcf9f58f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geGLqxsv'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bb2627-8d23-4397-ba90-668f9c187415]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43fc96-5b42-4f27-8cba-321fd304e428]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0222ae8a-fc28-4247-9181-4aa072c80212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260]
Nov 03 16:27:41 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64e3e9-e851-49d4-bf09-473650612a1d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefbd8d1-bf7b-445f-9c67-af46eacc897c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7440fe44-a727-4dca-bcba-f8016d352e64]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geGLqxsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: be942262-61f1-452b-bda1-5185b321477b] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26138383434373138', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138383434373138', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1869007814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1869007814',id=2,image_ref='dda83f43-ba9e-4f18-ad55-d343e16fee5b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-271065144',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-me8mqfb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member',shelved_at='2023-11-03T16:25:02.071975',shelved_host='user',shelved_image_id='dda83f43-ba9e-4f18-ad55-d343e16fee5b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=0238b778-b9e2-4a5b-82f2-5d58a6a552e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.objects.instance [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'pci_devices' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.objects.base [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<0238b778-b9e2-4a5b-82f2-5d58a6a552e7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:27:42 user nova-compute[74932]:   <uuid>0238b778-b9e2-4a5b-82f2-5d58a6a552e7</uuid>
Nov 03 16:27:42 user nova-compute[74932]:   <name>instance-00000002</name>
Nov 03 16:27:42 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:27:42 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:27:42 user nova-compute[74932]:   <metadata>
Nov 03 16:27:42 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:42 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:27:42 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1869007814</nova:name>
Nov 03 16:27:42 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:27:41</nova:creationTime>
Nov 03 16:27:42 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:27:42 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:42 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:27:42 user nova-compute[74932]:       <nova:owner>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:user uuid="6fd49e83fa0846d191cb4cf0719ba038">tempest-AttachVolumeShelveTestJSON-1586732873-project-member</nova:user>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:project uuid="b101d0f7f99a41f699e3f2701cc35248">tempest-AttachVolumeShelveTestJSON-1586732873</nova:project>
Nov 03 16:27:42 user nova-compute[74932]:       </nova:owner>
Nov 03 16:27:42 user nova-compute[74932]:       <nova:root type="image" uuid="dda83f43-ba9e-4f18-ad55-d343e16fee5b"/>
Nov 03 16:27:42 user nova-compute[74932]:       <nova:ports>
Nov 03 16:27:42 user nova-compute[74932]:         <nova:port uuid="7d0caef5-f058-4eca-b838-2cf6bf7cae2d">
Nov 03 16:27:42 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 16:27:42 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:42 user nova-compute[74932]:       </nova:ports>
Nov 03 16:27:42 user nova-compute[74932]:     </nova:instance>
Nov 03 16:27:42 user nova-compute[74932]:   </metadata>
Nov 03 16:27:42 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:27:42 user nova-compute[74932]:     <system>
Nov 03 16:27:42 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:27:42 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:27:42 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:27:42 user nova-compute[74932]:       <entry name="serial">0238b778-b9e2-4a5b-82f2-5d58a6a552e7</entry>
Nov 03 16:27:42 user nova-compute[74932]:       <entry name="uuid">0238b778-b9e2-4a5b-82f2-5d58a6a552e7</entry>
Nov 03 16:27:42 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:27:42 user nova-compute[74932]:     </system>
Nov 03 16:27:42 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:42 user nova-compute[74932]:   <os>
Nov 03 16:27:42 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:27:42 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:27:42 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:27:42 user nova-compute[74932]:   </os>
Nov 03 16:27:42 user nova-compute[74932]:   <features>
Nov 03 16:27:42 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:42 user nova-compute[74932]:     <apic/>
Nov 03 16:27:42 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:27:42 user nova-compute[74932]:   </features>
Nov 03 16:27:42 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:27:42 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:27:42 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:27:42 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:27:42 user nova-compute[74932]:   </clock>
Nov 03 16:27:42 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:27:42 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:27:42 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:27:42 user nova-compute[74932]:   </cpu>
Nov 03 16:27:42 user nova-compute[74932]:   <devices>
Nov 03 16:27:42 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:27:42 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:27:42 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk"/>
Nov 03 16:27:42 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:27:42 user nova-compute[74932]:     </disk>
Nov 03 16:27:42 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:27:42 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:27:42 user nova-compute[74932]:       <source dev="/dev/sdc"/>
Nov 03 16:27:42 user nova-compute[74932]:       <target dev="vdc" bus="virtio"/>
Nov 03 16:27:42 user nova-compute[74932]:       <serial>c49daba7-6951-4cac-9b1d-bafe28733fd8</serial>
Nov 03 16:27:42 user nova-compute[74932]:     </disk>
Nov 03 16:27:42 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:42 user nova-compute[74932]:       <mac address="fa:16:3e:39:ca:4b"/>
Nov 03 16:27:42 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:42 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:42 user nova-compute[74932]:       <target dev="tap7d0caef5-f0"/>
Nov 03 16:27:42 user nova-compute[74932]:     </interface>
Nov 03 16:27:42 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:27:42 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/console.log" append="off"/>
Nov 03 16:27:42 user nova-compute[74932]:     </serial>
Nov 03 16:27:42 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:27:42 user nova-compute[74932]:     <video>
Nov 03 16:27:42 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:42 user nova-compute[74932]:     </video>
Nov 03 16:27:42 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:27:42 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:27:42 user nova-compute[74932]:     </rng>
Nov 03 16:27:42 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:27:42 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:27:42 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:27:42 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:42 user nova-compute[74932]:   </devices>
Nov 03 16:27:42 user nova-compute[74932]: </domain>
Nov 03 16:27:42 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1869007814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1869007814',id=2,image_ref='dda83f43-ba9e-4f18-ad55-d343e16fee5b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-271065144',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-me8mqfb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member',shelved_at='2023-11-03T16:25:02.071975',shelved_host='user',shelved_image_id='dda83f43-ba9e-4f18-ad55-d343e16fee5b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=0238b778-b9e2-4a5b-82f2-5d58a6a552e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG os_vif [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '701ce5c6-0f6f-5b78-86b3-5f5bc190e83e', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d0caef5-f0, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d0caef5-f0, col_values=(('qos', UUID('1ae56ac6-49ae-4f4e-b175-bbc40017f253')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d0caef5-f0, col_values=(('external_ids', {'iface-id': '7d0caef5-f058-4eca-b838-2cf6bf7cae2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ca:4b', 'vm-uuid': '0238b778-b9e2-4a5b-82f2-5d58a6a552e7'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:42 user nova-compute[74932]: INFO os_vif [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0')
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No VIF found with MAC fa:16:3e:39:ca:4b, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating instance_info_cache with network_info: [{"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-be942262-61f1-452b-bda1-5185b321477b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: be942262-61f1-452b-bda1-5185b321477b] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:27:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:27:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:27:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance spawned successfully.
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-077bba87-a9ad-4635-9dca-34ba7ecb5a44 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 38.583s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:27:48 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:48 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=25.359092712402344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Applying migration context for instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 as it has an incoming, in-progress migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e. Migration status is post-migrating {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 16:27:48 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating resource usage from migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance be942262-61f1-452b-bda1-5185b321477b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 318067b8-c589-4008-b154-5220a87e598e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance a06239ec-5943-4ca5-a9f8-5421c3a6528d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:27:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-12c87144-dd99-4217-8838-6dca0b51e6a1 req-4c4b664a-6ec7-43e7-854c-09659b5c5d47 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-12c87144-dd99-4217-8838-6dca0b51e6a1 req-4c4b664a-6ec7-43e7-854c-09659b5c5d47 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-12c87144-dd99-4217-8838-6dca0b51e6a1 req-4c4b664a-6ec7-43e7-854c-09659b5c5d47 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-12c87144-dd99-4217-8838-6dca0b51e6a1 req-4c4b664a-6ec7-43e7-854c-09659b5c5d47 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-12c87144-dd99-4217-8838-6dca0b51e6a1 req-4c4b664a-6ec7-43e7-854c-09659b5c5d47 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:49 user nova-compute[74932]: WARNING nova.compute.manager [req-12c87144-dd99-4217-8838-6dca0b51e6a1 req-4c4b664a-6ec7-43e7-854c-09659b5c5d47 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state active and task_state None.
Nov 03 16:27:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:27:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:27:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-81ce54ca-85b8-48ac-8c4c-7facf8dbd009 req-becffd4c-3a1b-4f46-aa0d-878741b4fe05 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-81ce54ca-85b8-48ac-8c4c-7facf8dbd009 req-becffd4c-3a1b-4f46-aa0d-878741b4fe05 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-81ce54ca-85b8-48ac-8c4c-7facf8dbd009 req-becffd4c-3a1b-4f46-aa0d-878741b4fe05 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-81ce54ca-85b8-48ac-8c4c-7facf8dbd009 req-becffd4c-3a1b-4f46-aa0d-878741b4fe05 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-81ce54ca-85b8-48ac-8c4c-7facf8dbd009 req-becffd4c-3a1b-4f46-aa0d-878741b4fe05 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:51 user nova-compute[74932]: WARNING nova.compute.manager [req-81ce54ca-85b8-48ac-8c4c-7facf8dbd009 req-becffd4c-3a1b-4f46-aa0d-878741b4fe05 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state active and task_state None.
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "e28e1da8-57bb-4116-8379-283afd127d01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:27:52 user nova-compute[74932]: INFO nova.compute.claims [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Claim successful on node user
Nov 03 16:27:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:52 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.policy [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5705e3f08090409592cb9f2349d073cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2a9f790bc64682a55a649f8587e758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:27:52 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Creating image(s)
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "/opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "/opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "/opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.227s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk 1073741824" returned: 0 in 0.058s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Successfully created port: 96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Cannot resize image /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Ensure instance console log exists: /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Successfully updated port: 96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "refresh_cache-e28e1da8-57bb-4116-8379-283afd127d01" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquired lock "refresh_cache-e28e1da8-57bb-4116-8379-283afd127d01" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received event network-changed-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Refreshing instance network info cache due to event network-changed-96e1243b-e485-47ac-96b3-d1af0598d2da. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] Acquiring lock "refresh_cache-e28e1da8-57bb-4116-8379-283afd127d01" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:27:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Updating instance_info_cache with network_info: [{"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Releasing lock "refresh_cache-e28e1da8-57bb-4116-8379-283afd127d01" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Instance network_info: |[{"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] Acquired lock "refresh_cache-e28e1da8-57bb-4116-8379-283afd127d01" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.neutron [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Refreshing network info cache for port 96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Start _get_guest_xml network_info=[{"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:27:55 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:55 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1447963520',display_name='tempest-VolumesActionsTest-instance-1447963520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1447963520',id=14,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab2a9f790bc64682a55a649f8587e758',ramdisk_id='',reservation_id='r-s0ethad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1346474218',owner_user_name='tempest-VolumesActionsTest-1346474218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:53Z,user_data=None,user_id='5705e3f08090409592cb9f2349d073cb',uuid=e28e1da8-57bb-4116-8379-283afd127d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Converting VIF {"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lazy-loading 'pci_devices' on Instance uuid e28e1da8-57bb-4116-8379-283afd127d01 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:27:55 user nova-compute[74932]:   <uuid>e28e1da8-57bb-4116-8379-283afd127d01</uuid>
Nov 03 16:27:55 user nova-compute[74932]:   <name>instance-0000000e</name>
Nov 03 16:27:55 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:27:55 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:27:55 user nova-compute[74932]:   <metadata>
Nov 03 16:27:55 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:55 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:27:55 user nova-compute[74932]:       <nova:name>tempest-VolumesActionsTest-instance-1447963520</nova:name>
Nov 03 16:27:55 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:27:55</nova:creationTime>
Nov 03 16:27:55 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:27:55 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:55 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:27:55 user nova-compute[74932]:       <nova:owner>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:user uuid="5705e3f08090409592cb9f2349d073cb">tempest-VolumesActionsTest-1346474218-project-member</nova:user>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:project uuid="ab2a9f790bc64682a55a649f8587e758">tempest-VolumesActionsTest-1346474218</nova:project>
Nov 03 16:27:55 user nova-compute[74932]:       </nova:owner>
Nov 03 16:27:55 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:55 user nova-compute[74932]:       <nova:ports>
Nov 03 16:27:55 user nova-compute[74932]:         <nova:port uuid="96e1243b-e485-47ac-96b3-d1af0598d2da">
Nov 03 16:27:55 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:27:55 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:55 user nova-compute[74932]:       </nova:ports>
Nov 03 16:27:55 user nova-compute[74932]:     </nova:instance>
Nov 03 16:27:55 user nova-compute[74932]:   </metadata>
Nov 03 16:27:55 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:27:55 user nova-compute[74932]:     <system>
Nov 03 16:27:55 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:27:55 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:27:55 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:27:55 user nova-compute[74932]:       <entry name="serial">e28e1da8-57bb-4116-8379-283afd127d01</entry>
Nov 03 16:27:55 user nova-compute[74932]:       <entry name="uuid">e28e1da8-57bb-4116-8379-283afd127d01</entry>
Nov 03 16:27:55 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:27:55 user nova-compute[74932]:     </system>
Nov 03 16:27:55 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:55 user nova-compute[74932]:   <os>
Nov 03 16:27:55 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:27:55 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:27:55 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:27:55 user nova-compute[74932]:   </os>
Nov 03 16:27:55 user nova-compute[74932]:   <features>
Nov 03 16:27:55 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:55 user nova-compute[74932]:     <apic/>
Nov 03 16:27:55 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:27:55 user nova-compute[74932]:   </features>
Nov 03 16:27:55 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:27:55 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:27:55 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:27:55 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:27:55 user nova-compute[74932]:   </clock>
Nov 03 16:27:55 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:27:55 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:27:55 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:27:55 user nova-compute[74932]:   </cpu>
Nov 03 16:27:55 user nova-compute[74932]:   <devices>
Nov 03 16:27:55 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:27:55 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:27:55 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk"/>
Nov 03 16:27:55 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:27:55 user nova-compute[74932]:     </disk>
Nov 03 16:27:55 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:55 user nova-compute[74932]:       <mac address="fa:16:3e:53:84:73"/>
Nov 03 16:27:55 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:55 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:55 user nova-compute[74932]:       <target dev="tap96e1243b-e4"/>
Nov 03 16:27:55 user nova-compute[74932]:     </interface>
Nov 03 16:27:55 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:27:55 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/console.log" append="off"/>
Nov 03 16:27:55 user nova-compute[74932]:     </serial>
Nov 03 16:27:55 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:27:55 user nova-compute[74932]:     <video>
Nov 03 16:27:55 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:55 user nova-compute[74932]:     </video>
Nov 03 16:27:55 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:27:55 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:27:55 user nova-compute[74932]:     </rng>
Nov 03 16:27:55 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:27:55 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:27:55 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:27:55 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:55 user nova-compute[74932]:   </devices>
Nov 03 16:27:55 user nova-compute[74932]: </domain>
Nov 03 16:27:55 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1447963520',display_name='tempest-VolumesActionsTest-instance-1447963520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1447963520',id=14,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab2a9f790bc64682a55a649f8587e758',ramdisk_id='',reservation_id='r-s0ethad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1346474218',owner_user_name='tempest-VolumesActionsTest-1346474218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:53Z,user_data=None,user_id='5705e3f08090409592cb9f2349d073cb',uuid=e28e1da8-57bb-4116-8379-283afd127d01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Converting VIF {"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG os_vif [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63f5520e-41ae-5b7a-a28a-d2f5872b3e6a', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96e1243b-e4, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96e1243b-e4, col_values=(('qos', UUID('6c318173-4405-4511-9616-6db8b474278c')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96e1243b-e4, col_values=(('external_ids', {'iface-id': '96e1243b-e485-47ac-96b3-d1af0598d2da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:84:73', 'vm-uuid': 'e28e1da8-57bb-4116-8379-283afd127d01'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:55 user nova-compute[74932]: INFO os_vif [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4')
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] No VIF found with MAC fa:16:3e:53:84:73, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.neutron [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Updated VIF entry in instance network info cache for port 96e1243b-e485-47ac-96b3-d1af0598d2da. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG nova.network.neutron [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Updating instance_info_cache with network_info: [{"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:27:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cc50ae88-0761-4810-85e4-34e850ee1987 req-f563a494-2db3-4e6e-b3af-b211572866af service nova] Releasing lock "refresh_cache-e28e1da8-57bb-4116-8379-283afd127d01" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:27:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Starting finish_migration {{(pid=74932) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:27:57 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Creating image(s)
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-884b65e8-5cc4-4464-9c60-aa1b395d4be9 req-86b1e5eb-63e0-4c5e-8100-f0a55de93be2 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received event network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-884b65e8-5cc4-4464-9c60-aa1b395d4be9 req-86b1e5eb-63e0-4c5e-8100-f0a55de93be2 service nova] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-884b65e8-5cc4-4464-9c60-aa1b395d4be9 req-86b1e5eb-63e0-4c5e-8100-f0a55de93be2 service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-884b65e8-5cc4-4464-9c60-aa1b395d4be9 req-86b1e5eb-63e0-4c5e-8100-f0a55de93be2 service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-884b65e8-5cc4-4464-9c60-aa1b395d4be9 req-86b1e5eb-63e0-4c5e-8100-f0a55de93be2 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] No waiting events found dispatching network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:57 user nova-compute[74932]: WARNING nova.compute.manager [req-884b65e8-5cc4-4464-9c60-aa1b395d4be9 req-86b1e5eb-63e0-4c5e-8100-f0a55de93be2 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received unexpected event network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da for instance with vm_state building and task_state spawning.
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.235s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk. size=21474836480 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk 21474836480 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk 21474836480" returned: 0 in 0.059s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Ensure instance console log exists: /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start _get_guest_xml network_info=[{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cb4bd028-91a8-489d-ab27-e5dc6d75a7b7', 'attached_at': '2023-11-03T16:27:57.000000', 'detached_at': '', 'volume_id': '13b5fdcc-d757-449e-ae07-198e9d622b2f', 'serial': '13b5fdcc-d757-449e-ae07-198e9d622b2f'}, 'attachment_id': '78504d74-55ef-4c14-8fc5-d32a0e34d4e0', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:27:57 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:57 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:27:57 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:57 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:27:57 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e9b244-b2e3-4f52-a278-fdbb01e4e7d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:27:57 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[13954e05-c97c-47b6-b2b2-aa32d26788dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f] added
Nov 03 16:27:57 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb563ba-8485-4c20-bfaa-c2c285b2d27c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[73377cee-99e3-495c-8ac6-a9aa3c9b009a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETVOdxnp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETVOdxnp" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3729273-771e-4b41-86eb-3cb3af38bf81]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETVOdxnp'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32de7a-2518-4921-aba1-c8ff2839400d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0def4b-2479-48e3-b4f4-0631c5d47851]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:57 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b0a53-5566-4ef5-b66d-0a1201096e52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]
Nov 03 16:27:58 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.
Nov 03 16:27:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac30db-0db2-4a4c-b0f8-26f3d4686eb0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eb95c9-da62-4179-ae40-64989f212c92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:27:58 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:27:58 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[416dbff6-8301-4f19-835b-3154be550dd9]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:58 user nova-compute[74932]: INFO nova.compute.manager [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Terminating instance
Nov 03 16:27:58 user nova-compute[74932]: DEBUG nova.compute.manager [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23462386631663662', 'path': '/dev/sdf'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462386631663662', 'path': '/dev/sdf'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:27:59 user nova-compute[74932]:   <uuid>cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</uuid>
Nov 03 16:27:59 user nova-compute[74932]:   <name>instance-00000003</name>
Nov 03 16:27:59 user nova-compute[74932]:   <memory>2097152</memory>
Nov 03 16:27:59 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:27:59 user nova-compute[74932]:   <metadata>
Nov 03 16:27:59 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:27:59 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:27:59 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherB-server-103654683</nova:name>
Nov 03 16:27:59 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:27:57</nova:creationTime>
Nov 03 16:27:59 user nova-compute[74932]:       <nova:flavor name="m1.small">
Nov 03 16:27:59 user nova-compute[74932]:         <nova:memory>2048</nova:memory>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:disk>20</nova:disk>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:27:59 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:27:59 user nova-compute[74932]:       <nova:owner>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:user uuid="bcd6f5749c77427883db867a8de18c2f">tempest-ServerActionsTestOtherB-2075500504-project-member</nova:user>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:project uuid="e4a734f8e7b34fd1b14f878955a48490">tempest-ServerActionsTestOtherB-2075500504</nova:project>
Nov 03 16:27:59 user nova-compute[74932]:       </nova:owner>
Nov 03 16:27:59 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:27:59 user nova-compute[74932]:       <nova:ports>
Nov 03 16:27:59 user nova-compute[74932]:         <nova:port uuid="7ab56479-82d0-433f-a971-d25a3edff1ed">
Nov 03 16:27:59 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:27:59 user nova-compute[74932]:         </nova:port>
Nov 03 16:27:59 user nova-compute[74932]:       </nova:ports>
Nov 03 16:27:59 user nova-compute[74932]:     </nova:instance>
Nov 03 16:27:59 user nova-compute[74932]:   </metadata>
Nov 03 16:27:59 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:27:59 user nova-compute[74932]:     <system>
Nov 03 16:27:59 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:27:59 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:27:59 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:27:59 user nova-compute[74932]:       <entry name="serial">cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</entry>
Nov 03 16:27:59 user nova-compute[74932]:       <entry name="uuid">cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</entry>
Nov 03 16:27:59 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:27:59 user nova-compute[74932]:     </system>
Nov 03 16:27:59 user nova-compute[74932]:   </sysinfo>
Nov 03 16:27:59 user nova-compute[74932]:   <os>
Nov 03 16:27:59 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:27:59 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:27:59 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:27:59 user nova-compute[74932]:   </os>
Nov 03 16:27:59 user nova-compute[74932]:   <features>
Nov 03 16:27:59 user nova-compute[74932]:     <acpi/>
Nov 03 16:27:59 user nova-compute[74932]:     <apic/>
Nov 03 16:27:59 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:27:59 user nova-compute[74932]:   </features>
Nov 03 16:27:59 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:27:59 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:27:59 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:27:59 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:27:59 user nova-compute[74932]:   </clock>
Nov 03 16:27:59 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:27:59 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:27:59 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:27:59 user nova-compute[74932]:   </cpu>
Nov 03 16:27:59 user nova-compute[74932]:   <devices>
Nov 03 16:27:59 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:27:59 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:27:59 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk"/>
Nov 03 16:27:59 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:27:59 user nova-compute[74932]:     </disk>
Nov 03 16:27:59 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:27:59 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:27:59 user nova-compute[74932]:       <source dev="/dev/sdf"/>
Nov 03 16:27:59 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:27:59 user nova-compute[74932]:       <serial>13b5fdcc-d757-449e-ae07-198e9d622b2f</serial>
Nov 03 16:27:59 user nova-compute[74932]:     </disk>
Nov 03 16:27:59 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:27:59 user nova-compute[74932]:       <mac address="fa:16:3e:d0:fa:36"/>
Nov 03 16:27:59 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:59 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:27:59 user nova-compute[74932]:       <target dev="tap7ab56479-82"/>
Nov 03 16:27:59 user nova-compute[74932]:     </interface>
Nov 03 16:27:59 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:27:59 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/console.log" append="off"/>
Nov 03 16:27:59 user nova-compute[74932]:     </serial>
Nov 03 16:27:59 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:27:59 user nova-compute[74932]:     <video>
Nov 03 16:27:59 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:27:59 user nova-compute[74932]:     </video>
Nov 03 16:27:59 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:27:59 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:27:59 user nova-compute[74932]:     </rng>
Nov 03 16:27:59 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:27:59 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:27:59 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:27:59 user nova-compute[74932]:     </memballoon>
Nov 03 16:27:59 user nova-compute[74932]:   </devices>
Nov 03 16:27:59 user nova-compute[74932]: </domain>
Nov 03 16:27:59 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1196624487-network", "vif_mac": "fa:16:3e:d0:fa:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG os_vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eb53e9d-7f4a-5fa6-aa92-27a931162e08', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 318067b8-c589-4008-b154-5220a87e598e] Instance destroyed successfully.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lazy-loading 'resources' on Instance uuid 318067b8-c589-4008-b154-5220a87e598e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ab56479-82, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ab56479-82, col_values=(('qos', UUID('419a040a-5fc1-455d-8ce1-11ca627c1d03')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ab56479-82, col_values=(('external_ids', {'iface-id': '7ab56479-82d0-433f-a971-d25a3edff1ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fa:36', 'vm-uuid': 'cb4bd028-91a8-489d-ab27-e5dc6d75a7b7'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1888885135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1888885135',id=8,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+c7xjtKfFPPfaoNhj+CbEEpxfzUgakXHQ53jRkF54wWpMKFQhcoCaiHInZwi8NGFhO0zUkNL+QipQ3717N4/rUKD49Q4oJqrVo9+Rye2pyuoF5EiAdiYy5PvIim7Zgw==',key_name='tempest-keypair-1646271117',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='637cbdeb134a457cb9652bf70048083a',ramdisk_id='',reservation_id='r-z7ymkv7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-518552287',owner_user_name='tempest-TaggedAttachmentsTest-518552287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba5285c331f4fe2a170ed8623aed9c9',uuid=318067b8-c589-4008-b154-5220a87e598e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converting VIF {"id": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "address": "fa:16:3e:f8:5a:db", "network": {"id": "90f48793-7c99-4eec-8de7-40d6e43087a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-215584830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "637cbdeb134a457cb9652bf70048083a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca44a20-17", "ovs_interfaceid": "9ca44a20-177b-4dd1-9d6c-f752f5127ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG os_vif [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: INFO os_vif [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82')
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ca44a20-17, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8550fd68-191f-4767-839c-86476ae3073e) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:27:59 user nova-compute[74932]: INFO os_vif [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5a:db,bridge_name='br-int',has_traffic_filtering=True,id=9ca44a20-177b-4dd1-9d6c-f752f5127ca3,network=Network(90f48793-7c99-4eec-8de7-40d6e43087a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca44a20-17')
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Deleting instance files /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e_del
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Deletion of /opt/stack/data/nova/instances/318067b8-c589-4008-b154-5220a87e598e_del complete
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received event network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] No waiting events found dispatching network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:59 user nova-compute[74932]: WARNING nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received unexpected event network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da for instance with vm_state building and task_state spawning.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-unplugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-unplugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-unplugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Acquiring lock "318067b8-c589-4008-b154-5220a87e598e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] Lock "318067b8-c589-4008-b154-5220a87e598e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] No waiting events found dispatching network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:27:59 user nova-compute[74932]: WARNING nova.compute.manager [req-c74a49dc-88cd-428b-afff-f5185e2ddd41 req-384fed24-fc5c-4dee-aba8-ee86c830d35a service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received unexpected event network-vif-plugged-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 for instance with vm_state active and task_state deleting.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] No VIF found with MAC fa:16:3e:d0:fa:36, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Instance spawned successfully.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.compute.manager [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] [instance: 318067b8-c589-4008-b154-5220a87e598e] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 318067b8-c589-4008-b154-5220a87e598e] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 318067b8-c589-4008-b154-5220a87e598e] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:27:59 user nova-compute[74932]: INFO nova.compute.manager [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Took 7.74 seconds to build instance.
Nov 03 16:27:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f15bbe9e-0b55-4aa4-9e56-1c1209aa0bcd tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "e28e1da8-57bb-4116-8379-283afd127d01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.857s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:00 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 318067b8-c589-4008-b154-5220a87e598e] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:28:00 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 318067b8-c589-4008-b154-5220a87e598e] Took 1.03 seconds to deallocate network for instance.
Nov 03 16:28:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-66b17015-b8e3-4e86-adff-18a0573e2cbe req-7431f2cd-8a8c-40c9-9e4d-5976fb404042 service nova] [instance: 318067b8-c589-4008-b154-5220a87e598e] Received event network-vif-deleted-9ca44a20-177b-4dd1-9d6c-f752f5127ca3 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:28:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-641ae237-fc77-4876-8104-2ca847f745ca req-3d6c48fa-efe7-41c1-9454-d29d1ae2b81f service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-641ae237-fc77-4876-8104-2ca847f745ca req-3d6c48fa-efe7-41c1-9454-d29d1ae2b81f service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-641ae237-fc77-4876-8104-2ca847f745ca req-3d6c48fa-efe7-41c1-9454-d29d1ae2b81f service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-641ae237-fc77-4876-8104-2ca847f745ca req-3d6c48fa-efe7-41c1-9454-d29d1ae2b81f service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-641ae237-fc77-4876-8104-2ca847f745ca req-3d6c48fa-efe7-41c1-9454-d29d1ae2b81f service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:28:01 user nova-compute[74932]: WARNING nova.compute.manager [req-641ae237-fc77-4876-8104-2ca847f745ca req-3d6c48fa-efe7-41c1-9454-d29d1ae2b81f service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state resize_finish.
Nov 03 16:28:01 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:01 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Deleted allocations for instance 318067b8-c589-4008-b154-5220a87e598e
Nov 03 16:28:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-84dc8512-88f6-4d29-b8c6-a7dbc316d5c9 tempest-TaggedAttachmentsTest-518552287 tempest-TaggedAttachmentsTest-518552287-project-member] Lock "318067b8-c589-4008-b154-5220a87e598e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.969s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:28:03 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance running successfully.
Nov 03 16:28:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Failed to set time: agent not configured {{(pid=74932) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3a32631-9e3b-466f-8e17-01f06baca360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] finish_migration finished successfully. {{(pid=74932) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-f327deca-4a7c-46b6-b33a-8cf3da7e8977 req-566bb214-a7ca-4692-bd76-ff50a2f02155 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f327deca-4a7c-46b6-b33a-8cf3da7e8977 req-566bb214-a7ca-4692-bd76-ff50a2f02155 service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f327deca-4a7c-46b6-b33a-8cf3da7e8977 req-566bb214-a7ca-4692-bd76-ff50a2f02155 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f327deca-4a7c-46b6-b33a-8cf3da7e8977 req-566bb214-a7ca-4692-bd76-ff50a2f02155 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-f327deca-4a7c-46b6-b33a-8cf3da7e8977 req-566bb214-a7ca-4692-bd76-ff50a2f02155 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:28:03 user nova-compute[74932]: WARNING nova.compute.manager [req-f327deca-4a7c-46b6-b33a-8cf3da7e8977 req-566bb214-a7ca-4692-bd76-ff50a2f02155 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state resize_finish.
Nov 03 16:28:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:28:09 user nova-compute[74932]: INFO nova.compute.claims [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Claim successful on node user
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:28:09 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:28:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.policy [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b635150c614e459357225b83825e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be38a61a4094c9695a4111abe168c74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:28:10 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Creating image(s)
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "/opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "/opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.220s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk 1073741824" returned: 0 in 0.055s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Cannot resize image /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Ensure instance console log exists: /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Successfully created port: 960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Successfully updated port: 960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquired lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-changed-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Refreshing instance network info cache due to event network-changed-960126c0-deac-4948-89c7-c42defe84a9f. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] Acquiring lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:28:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating instance_info_cache with network_info: [{"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Releasing lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Instance network_info: |[{"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] Acquired lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Refreshing network info cache for port 960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Start _get_guest_xml network_info=[{"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:28:12 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:28:12 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-833970234',display_name='tempest-AttachVolumeNegativeTest-server-833970234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-833970234',id=15,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN5HQr7IR3KoR0UMaY4JH8gSzVpM4Oz2MT5EQAsUgnlTxka4LruIJ0akweVncgxfp31dvfrbXVLD+CD6913AzVIpDzQ9Osf4p7q2oquI8jekzNNEryfMrujvTsR+VF8mQ==',key_name='tempest-keypair-1858235203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-95jme9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=1b97e423-b373-4f86-8ad7-281b30af23ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b97e423-b373-4f86-8ad7-281b30af23ee {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:28:12 user nova-compute[74932]:   <uuid>1b97e423-b373-4f86-8ad7-281b30af23ee</uuid>
Nov 03 16:28:12 user nova-compute[74932]:   <name>instance-0000000f</name>
Nov 03 16:28:12 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:28:12 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:28:12 user nova-compute[74932]:   <metadata>
Nov 03 16:28:12 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:28:12 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:28:12 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeNegativeTest-server-833970234</nova:name>
Nov 03 16:28:12 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:28:12</nova:creationTime>
Nov 03 16:28:12 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:28:12 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:28:12 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:28:12 user nova-compute[74932]:       <nova:owner>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:user uuid="72b635150c614e459357225b83825e63">tempest-AttachVolumeNegativeTest-855411700-project-member</nova:user>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:project uuid="3be38a61a4094c9695a4111abe168c74">tempest-AttachVolumeNegativeTest-855411700</nova:project>
Nov 03 16:28:12 user nova-compute[74932]:       </nova:owner>
Nov 03 16:28:12 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:28:12 user nova-compute[74932]:       <nova:ports>
Nov 03 16:28:12 user nova-compute[74932]:         <nova:port uuid="960126c0-deac-4948-89c7-c42defe84a9f">
Nov 03 16:28:12 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:28:12 user nova-compute[74932]:         </nova:port>
Nov 03 16:28:12 user nova-compute[74932]:       </nova:ports>
Nov 03 16:28:12 user nova-compute[74932]:     </nova:instance>
Nov 03 16:28:12 user nova-compute[74932]:   </metadata>
Nov 03 16:28:12 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:28:12 user nova-compute[74932]:     <system>
Nov 03 16:28:12 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:28:12 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:28:12 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:28:12 user nova-compute[74932]:       <entry name="serial">1b97e423-b373-4f86-8ad7-281b30af23ee</entry>
Nov 03 16:28:12 user nova-compute[74932]:       <entry name="uuid">1b97e423-b373-4f86-8ad7-281b30af23ee</entry>
Nov 03 16:28:12 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:28:12 user nova-compute[74932]:     </system>
Nov 03 16:28:12 user nova-compute[74932]:   </sysinfo>
Nov 03 16:28:12 user nova-compute[74932]:   <os>
Nov 03 16:28:12 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:28:12 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:28:12 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:28:12 user nova-compute[74932]:   </os>
Nov 03 16:28:12 user nova-compute[74932]:   <features>
Nov 03 16:28:12 user nova-compute[74932]:     <acpi/>
Nov 03 16:28:12 user nova-compute[74932]:     <apic/>
Nov 03 16:28:12 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:28:12 user nova-compute[74932]:   </features>
Nov 03 16:28:12 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:28:12 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:28:12 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:28:12 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:28:12 user nova-compute[74932]:   </clock>
Nov 03 16:28:12 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:28:12 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:28:12 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:28:12 user nova-compute[74932]:   </cpu>
Nov 03 16:28:12 user nova-compute[74932]:   <devices>
Nov 03 16:28:12 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:28:12 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:28:12 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk"/>
Nov 03 16:28:12 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:28:12 user nova-compute[74932]:     </disk>
Nov 03 16:28:12 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:28:12 user nova-compute[74932]:       <mac address="fa:16:3e:88:4c:5b"/>
Nov 03 16:28:12 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:28:12 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:28:12 user nova-compute[74932]:       <target dev="tap960126c0-de"/>
Nov 03 16:28:12 user nova-compute[74932]:     </interface>
Nov 03 16:28:12 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:28:12 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/console.log" append="off"/>
Nov 03 16:28:12 user nova-compute[74932]:     </serial>
Nov 03 16:28:12 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:28:12 user nova-compute[74932]:     <video>
Nov 03 16:28:12 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:28:12 user nova-compute[74932]:     </video>
Nov 03 16:28:12 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:28:12 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:28:12 user nova-compute[74932]:     </rng>
Nov 03 16:28:12 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:28:12 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:28:12 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:28:12 user nova-compute[74932]:     </memballoon>
Nov 03 16:28:12 user nova-compute[74932]:   </devices>
Nov 03 16:28:12 user nova-compute[74932]: </domain>
Nov 03 16:28:12 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-833970234',display_name='tempest-AttachVolumeNegativeTest-server-833970234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-833970234',id=15,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN5HQr7IR3KoR0UMaY4JH8gSzVpM4Oz2MT5EQAsUgnlTxka4LruIJ0akweVncgxfp31dvfrbXVLD+CD6913AzVIpDzQ9Osf4p7q2oquI8jekzNNEryfMrujvTsR+VF8mQ==',key_name='tempest-keypair-1858235203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-95jme9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=1b97e423-b373-4f86-8ad7-281b30af23ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG os_vif [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3630d8a3-2d18-5edc-9b10-c9c70bb457ab', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap960126c0-de, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap960126c0-de, col_values=(('qos', UUID('c045ca4f-182d-4c5a-b2a5-8f07d8ed30b4')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap960126c0-de, col_values=(('external_ids', {'iface-id': '960126c0-deac-4948-89c7-c42defe84a9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:4c:5b', 'vm-uuid': '1b97e423-b373-4f86-8ad7-281b30af23ee'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: INFO os_vif [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de')
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No VIF found with MAC fa:16:3e:88:4c:5b, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updated VIF entry in instance network info cache for port 960126c0-deac-4948-89c7-c42defe84a9f. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating instance_info_cache with network_info: [{"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:28:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ce7e22f2-c0b0-43fb-9de7-eb5a0da083bd req-2315c13a-6a3e-47a2-b1d1-168ed4a8305b service nova] Releasing lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:28:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-bd60cf88-19da-40ba-9797-0b5c6958d65e req-8deaaa5b-1f3d-4bd5-b527-2f622da155fe service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bd60cf88-19da-40ba-9797-0b5c6958d65e req-8deaaa5b-1f3d-4bd5-b527-2f622da155fe service nova] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bd60cf88-19da-40ba-9797-0b5c6958d65e req-8deaaa5b-1f3d-4bd5-b527-2f622da155fe service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bd60cf88-19da-40ba-9797-0b5c6958d65e req-8deaaa5b-1f3d-4bd5-b527-2f622da155fe service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-bd60cf88-19da-40ba-9797-0b5c6958d65e req-8deaaa5b-1f3d-4bd5-b527-2f622da155fe service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] No waiting events found dispatching network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:28:14 user nova-compute[74932]: WARNING nova.compute.manager [req-bd60cf88-19da-40ba-9797-0b5c6958d65e req-8deaaa5b-1f3d-4bd5-b527-2f622da155fe service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received unexpected event network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f for instance with vm_state building and task_state spawning.
Nov 03 16:28:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:28:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Instance spawned successfully.
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:28:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:28:16 user nova-compute[74932]: INFO nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 03 16:28:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:28:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-451b92fe-a7e5-4382-bde3-bf84a8248447 req-4c56e3da-d647-4b87-9948-e602beb077ec service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:28:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-451b92fe-a7e5-4382-bde3-bf84a8248447 req-4c56e3da-d647-4b87-9948-e602beb077ec service nova] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-451b92fe-a7e5-4382-bde3-bf84a8248447 req-4c56e3da-d647-4b87-9948-e602beb077ec service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-451b92fe-a7e5-4382-bde3-bf84a8248447 req-4c56e3da-d647-4b87-9948-e602beb077ec service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-451b92fe-a7e5-4382-bde3-bf84a8248447 req-4c56e3da-d647-4b87-9948-e602beb077ec service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] No waiting events found dispatching network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:28:16 user nova-compute[74932]: WARNING nova.compute.manager [req-451b92fe-a7e5-4382-bde3-bf84a8248447 req-4c56e3da-d647-4b87-9948-e602beb077ec service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received unexpected event network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f for instance with vm_state building and task_state spawning.
Nov 03 16:28:16 user nova-compute[74932]: INFO nova.compute.manager [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Took 6.86 seconds to build instance.
Nov 03 16:28:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4857d3e-f693-4ed0-8e6c-17c0d357fc1c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.005s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:36 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:39 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:28:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid d94f2ba8-e23e-497c-aa29-b282d9bd79e9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updating instance_info_cache with network_info: [{"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-d94f2ba8-e23e-497c-aa29-b282d9bd79e9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:28:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:45 user nova-compute[74932]: INFO nova.compute.manager [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Unshelving
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:28:45 user nova-compute[74932]: INFO nova.virt.block_device [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Booting with volume 35980f7b-8727-4640-b188-99ed55d44a60 at /dev/vda
Nov 03 16:28:45 user nova-compute[74932]: DEBUG os_brick.utils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24a2eb-33d0-4a8c-b0b5-47b37f81ddc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.091s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c792fe9-63f1-43ec-a149-0c2f39cc325b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e251760-79db-4594-89ce-164542797cfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb713e9-bda9-4105-ab11-ac04420ed277]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:28:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:28:46 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05cf9b9-3a79-4896-b6b4-1a190c1d729a]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG os_brick.utils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] <== get_connector_properties: return (241ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating existing volume attachment record: 59abdbc7-a79b-430c-a6f6-77a69681ea35 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:28:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:28:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:49 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:28:49 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.41375732421875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Applying migration context for instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 as it has an incoming, in-progress migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e. Migration status is finished {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 16:28:49 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating resource usage from migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance be942262-61f1-452b-bda1-5185b321477b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance a06239ec-5943-4ca5-a9f8-5421c3a6528d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e28e1da8-57bb-4116-8379-283afd127d01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1b97e423-b373-4f86-8ad7-281b30af23ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d8e7e5d7-df88-4470-99f7-24f015dcf32a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:28:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.996s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:28:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:28:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:28:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:28:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:28:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:28:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:28:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:28:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:28:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:28:59 user nova-compute[74932]: INFO nova.compute.manager [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Detaching volume c49daba7-6951-4cac-9b1d-bafe28733fd8
Nov 03 16:28:59 user nova-compute[74932]: INFO nova.virt.block_device [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Attempting to driver detach volume c49daba7-6951-4cac-9b1d-bafe28733fd8 from mountpoint /dev/vdc
Nov 03 16:28:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Attempting to detach device vdc from instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:28:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:28:59 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:28:59 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:28:59 user nova-compute[74932]:   <target dev="vdc" bus="virtio"/>
Nov 03 16:28:59 user nova-compute[74932]:   <serial>c49daba7-6951-4cac-9b1d-bafe28733fd8</serial>
Nov 03 16:28:59 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 16:28:59 user nova-compute[74932]: </disk>
Nov 03 16:28:59 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:28:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully detached device vdc from instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 from the persistent domain config.
Nov 03 16:28:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:28:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:28:59 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:28:59 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:28:59 user nova-compute[74932]:   <target dev="vdc" bus="virtio"/>
Nov 03 16:28:59 user nova-compute[74932]:   <serial>c49daba7-6951-4cac-9b1d-bafe28733fd8</serial>
Nov 03 16:28:59 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 16:28:59 user nova-compute[74932]: </disk>
Nov 03 16:28:59 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:28:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:29:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-changed-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing instance network info cache due to event network-changed-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:29:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] Acquiring lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:29:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] Acquired lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:29:04 user nova-compute[74932]: DEBUG nova.network.neutron [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Refreshing network info cache for port f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:29:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updated VIF entry in instance network info cache for port f5008f1b-5165-4d01-823e-4d4c3fc4d5cc. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:29:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69c4048a-c649-4e44-8169-5a62008ff0d3 req-f46aab09-3add-4e13-bf9c-a544843f9158 service nova] Releasing lock "refresh_cache-caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:06 user nova-compute[74932]: WARNING nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid d94f2ba8-e23e-497c-aa29-b282d9bd79e9 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid be942262-61f1-452b-bda1-5185b321477b {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid a06239ec-5943-4ca5-a9f8-5421c3a6528d {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid e28e1da8-57bb-4116-8379-283afd127d01 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 1b97e423-b373-4f86-8ad7-281b30af23ee {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 391f8ba7-9f07-474e-b606-1abb8c9b3dee {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "e28e1da8-57bb-4116-8379-283afd127d01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: INFO nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "e28e1da8-57bb-4116-8379-283afd127d01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:06 user nova-compute[74932]: WARNING nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance is unexpectedly not found. Ignore.
Nov 03 16:29:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.183s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:07 user nova-compute[74932]: INFO nova.compute.manager [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Terminating instance
Nov 03 16:29:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'pci_requests' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'numa_topology' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:29:08 user nova-compute[74932]: INFO nova.compute.claims [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Claim successful on node user
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-9e216a3d-9c98-4928-80d6-846ceb3fdd25 req-7722652f-7120-4d6d-b0ba-f4c16cb3d2a5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9e216a3d-9c98-4928-80d6-846ceb3fdd25 req-7722652f-7120-4d6d-b0ba-f4c16cb3d2a5 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9e216a3d-9c98-4928-80d6-846ceb3fdd25 req-7722652f-7120-4d6d-b0ba-f4c16cb3d2a5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9e216a3d-9c98-4928-80d6-846ceb3fdd25 req-7722652f-7120-4d6d-b0ba-f4c16cb3d2a5 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-9e216a3d-9c98-4928-80d6-846ceb3fdd25 req-7722652f-7120-4d6d-b0ba-f4c16cb3d2a5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-9e216a3d-9c98-4928-80d6-846ceb3fdd25 req-7722652f-7120-4d6d-b0ba-f4c16cb3d2a5 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-2507f374-275d-4c75-8a34-64a9e36eed8d for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c241155-4211-4733-9a85-67193ed268a4 req-82151d5d-9310-4d1c-8f49-2b046dcb0310 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c241155-4211-4733-9a85-67193ed268a4 req-82151d5d-9310-4d1c-8f49-2b046dcb0310 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c241155-4211-4733-9a85-67193ed268a4 req-82151d5d-9310-4d1c-8f49-2b046dcb0310 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c241155-4211-4733-9a85-67193ed268a4 req-82151d5d-9310-4d1c-8f49-2b046dcb0310 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c241155-4211-4733-9a85-67193ed268a4 req-82151d5d-9310-4d1c-8f49-2b046dcb0310 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c241155-4211-4733-9a85-67193ed268a4 req-82151d5d-9310-4d1c-8f49-2b046dcb0310 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-45605bae-985a-47f3-86a0-a83db3ea4d90 req-3e927824-2a24-4b5b-8228-d33b9ad572cf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45605bae-985a-47f3-86a0-a83db3ea4d90 req-3e927824-2a24-4b5b-8228-d33b9ad572cf service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45605bae-985a-47f3-86a0-a83db3ea4d90 req-3e927824-2a24-4b5b-8228-d33b9ad572cf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45605bae-985a-47f3-86a0-a83db3ea4d90 req-3e927824-2a24-4b5b-8228-d33b9ad572cf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-45605bae-985a-47f3-86a0-a83db3ea4d90 req-3e927824-2a24-4b5b-8228-d33b9ad572cf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-45605bae-985a-47f3-86a0-a83db3ea4d90 req-3e927824-2a24-4b5b-8228-d33b9ad572cf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:08 user nova-compute[74932]: INFO nova.network.neutron [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating port 102e231c-e02f-4a02-8534-e22a3c48f0e8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 16:29:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Instance destroyed successfully.
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lazy-loading 'resources' on Instance uuid caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5008f1b-51, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8715ed5b-1ed4-47e5-9db5-1de37f5e3139) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:4b:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5008f1b-5165-4d01-823e-4d4c3fc4d5cc,network=Network(551c08ed-b1e9-4e2d-84c5-33734dd00448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5008f1b-51')
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2507f374-27, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2711aecb-85a3-41cb-86bc-dfee939e72ad) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=2507f374-275d-4c75-8a34-64a9e36eed8d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2507f374-27')
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f4d454e-94, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=867af6ad-05c6-4d5c-be99-42b281e3f62e) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f4d454e-94')
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "address": "fa:16:3e:e4:9d:48", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa20486a5-f5", "ovs_interfaceid": "a20486a5-f54d-4f05-828d-dfbc6b0cb66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa20486a5-f5, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e07127c-289f-4dc3-900b-310d7a4cddc4) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9d:48,bridge_name='br-int',has_traffic_filtering=True,id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa20486a5-f5')
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bfd246d-a0, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc for instance with vm_state active and task_state deleting.
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-a20486a5-f54d-4f05-828d-dfbc6b0cb66d for instance with vm_state active and task_state deleting.
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-68446b07-9b9e-45d2-8830-44d4fd7acd26 req-d405a3e4-3cad-43c7-8197-14bf148ebadf service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-348c7c87-85a8-41e6-a214-6170a5b2d721 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a527bd24-c01e-41f4-9650-247939fae039 req-ca779721-f587-47f4-bf32-73b1c97bc45f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a527bd24-c01e-41f4-9650-247939fae039 req-ca779721-f587-47f4-bf32-73b1c97bc45f service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a527bd24-c01e-41f4-9650-247939fae039 req-ca779721-f587-47f4-bf32-73b1c97bc45f service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a527bd24-c01e-41f4-9650-247939fae039 req-ca779721-f587-47f4-bf32-73b1c97bc45f service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a527bd24-c01e-41f4-9650-247939fae039 req-ca779721-f587-47f4-bf32-73b1c97bc45f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING nova.compute.manager [req-a527bd24-c01e-41f4-9650-247939fae039 req-ca779721-f587-47f4-bf32-73b1c97bc45f service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-2507f374-275d-4c75-8a34-64a9e36eed8d for instance with vm_state active and task_state deleting.
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b5a55e2-49ae-4322-9b46-59db4ce5c58f) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d7:de,bridge_name='br-int',has_traffic_filtering=True,id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e,network=Network(5276cd63-18fd-4679-8ec6-06d9ed677616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfd246d-a0')
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap348c7c87-85, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ffc8f2-c35c-4cc5-9091-f3b34527c6bf) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:6b:ed,bridge_name='br-int',has_traffic_filtering=True,id=348c7c87-85a8-41e6-a214-6170a5b2d721,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap348c7c87-85')
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:25:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1733698274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1733698274',id=12,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPSupDk1c0RuyOa4dTnjUTHVbLStCKC/5yK0rhXm3sIpJZjB9dy9o8b0xR7W50ruWXkXDSSR14kfxgKR94fByuGXRiFLKLvOvpq3hoxd9kZB/Ak23pFvczEvtUq8T5ww==',key_name='tempest-keypair-1760592167',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d7e1c111a34d35930b25a5357ae5db',ramdisk_id='',reservation_id='r-518ictsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-47404985',owner_user_name='tempest-TaggedBootDevicesTest-47404985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0014382a16714a6ea8f480165b94d8e9',uuid=caf006bb-ea6d-4d96-a6d6-dd9cb51cd072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converting VIF {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61357ead-7a, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cafc804-1478-4846-a1f2-fa4a2298959a) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:10 user nova-compute[74932]: INFO os_vif [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:bd:49,bridge_name='br-int',has_traffic_filtering=True,id=61357ead-7a4e-4809-8640-dbf23410df4f,network=Network(8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61357ead-7a')
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJnOyiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[653500dd-3bf8-4358-970f-2b8f461f773d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:29:10 user nova-compute[74932]: No targets found.
Nov 03 16:29:10 user nova-compute[74932]: iSNS:
Nov 03 16:29:10 user nova-compute[74932]: No targets found.
Nov 03 16:29:10 user nova-compute[74932]: STATIC:
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: FIRMWARE:
Nov 03 16:29:10 user nova-compute[74932]: No targets found.
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:29:10 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:29:10 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[917468f5-07f6-42f3-a2b1-855c337d1c3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee6a56-ecc5-4e7c-b0e0-1fb186986256]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6449a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b6cc9-ea42-4dbf-ac6e-0324bc441e90]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2fccdc-8516-498d-a2ce-e864c0a1de66]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227159a-eca8-4fde-b674-1f19e50841f4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a1f34b-d0ab-4cf1-8063-9e534e4025cd]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f for instance with vm_state active and task_state deleting.
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-0bfd246d-a03a-4e06-9e68-499e2ce5c73e for instance with vm_state active and task_state deleting.
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-unplugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-unplugged-61357ead-7a4e-4809-8640-dbf23410df4f for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING nova.compute.manager [req-a61d1e52-86fe-4a7a-9102-b2ee3e00dca0 req-67c4658b-b1d2-4f01-b71a-fefe718e08e9 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-61357ead-7a4e-4809-8640-dbf23410df4f for instance with vm_state active and task_state deleting.
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8baf0d-f435-497d-aa0e-9de69aab7322]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de0fa0-bea8-4697-9469-9232688ce84a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260]
Nov 03 16:29:10 user nova-compute[74932]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3583d6b-22b6-4d6a-9126-eb15a6febfcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e032a9-7f03-4593-a216-9e1045f457da]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== disconnect_volume: return (359ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoSrWPBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:10 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b0d197-ecce-4f12-9310-e813b523200a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:29:10 user nova-compute[74932]: No targets found.
Nov 03 16:29:10 user nova-compute[74932]: iSNS:
Nov 03 16:29:10 user nova-compute[74932]: No targets found.
Nov 03 16:29:10 user nova-compute[74932]: STATIC:
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8
Nov 03 16:29:10 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:10 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:10 user nova-compute[74932]: FIRMWARE:
Nov 03 16:29:10 user nova-compute[74932]: No targets found.
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:29:10 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:29:10 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee29938-4509-4ac9-b311-176b1c12c4f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1305533b-1546-4257-912f-1c1100ee20f0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:10 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64328820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d04bd-241c-4cb1-941e-f16803571a57]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e917e32d-6547-4328-80aa-c948a2fbc581]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e8ca86-e09d-400d-bc52-999f006ca1c5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:29:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7457280-e51b-4c92-b940-723514d49fc5]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a5777-dac9-4a09-9b1f-d1f891725fa3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a178e09-aee2-4e8f-903f-9562dfd46fb4]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260]
Nov 03 16:29:11 user nova-compute[74932]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:29:11 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Creating image(s)
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Start _get_guest_xml network_info=[{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8e7e5d7-df88-4470-99f7-24f015dcf32a', 'attached_at': '', 'detached_at': '', 'volume_id': '35980f7b-8727-4640-b188-99ed55d44a60', 'serial': '35980f7b-8727-4640-b188-99ed55d44a60'}, 'attachment_id': '59abdbc7-a79b-430c-a6f6-77a69681ea35', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:29:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:29:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f3d6038-8bdf-49cf-a5eb-e8b9ae1d19a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e856f-b529-4ce3-ac20-a89022c7bfd0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== disconnect_volume: return (366ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.objects.instance [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMSVuviP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.objects.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Object Instance<d8e7e5d7-df88-4470-99f7-24f015dcf32a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04056ba-f76a-4aa8-923e-bca9177f674e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:29:11 user nova-compute[74932]: No targets found.
Nov 03 16:29:11 user nova-compute[74932]: iSNS:
Nov 03 16:29:11 user nova-compute[74932]: No targets found.
Nov 03 16:29:11 user nova-compute[74932]: STATIC:
Nov 03 16:29:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0
Nov 03 16:29:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:29:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:29:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8
Nov 03 16:29:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:11 user nova-compute[74932]: FIRMWARE:
Nov 03 16:29:11 user nova-compute[74932]: No targets found.
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:29:11 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:29:11 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f63336-6aad-4845-a25d-d45ac7325f64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e2e6a-662d-466d-ad7e-7bf9c65cc222]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8cadaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0'): ({'sde'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Removing single pathed devices sde {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66914cc-dea8-4c21-a0d6-9d8f9d1e9560]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f8f6b-bbfa-4fb4-8aea-04fea5552c77]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Flushing IO for device /dev/sde {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb9f77-f41f-477c-8fe2-7f83e8072d93]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc219c-3ca8-482d-bf5f-ccb88c0a0572]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[211412d1-2fa7-4277-9473-834b820c6fdc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ef5b6d-1106-4ff7-8f6a-bcc85397ebee]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260]
Nov 03 16:29:11 user nova-compute[74932]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502874ac-5395-44bb-9af3-f5ddcf136ee0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f6afdf-de27-487b-a9df-d3985f53432b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] <== disconnect_volume: return (378ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:29:11 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Deleting instance files /opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072_del
Nov 03 16:29:11 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Deletion of /opt/stack/data/nova/instances/caf006bb-ea6d-4d96-a6d6-dd9cb51cd072_del complete
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.323s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:11 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb92e1b-3918-45da-b7a1-ad467cda8acd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:29:11 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec773bc4-e411-470a-b4be-bd084392250c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60] added
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: INFO nova.compute.manager [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Took 3.88 seconds to destroy the instance on the hypervisor.
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[351cd2ae-0550-414e-88b4-de9a3f4eb120]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90b4930-0685-488d-a375-c4f558e6dbb0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVhrZsAz {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVhrZsAz" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[168e0848-f8c2-4d59-a117-03fc76a5e553]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVhrZsAz'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684b6b7-c4af-4724-9125-1c11efee48a7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8a044-2f0c-4b13-b850-17ff3fdf6f32]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f271e4-96be-44f7-9797-c06bea045252]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]
Nov 03 16:29:11 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8832c994-f148-473f-9991-7ff47c04ed4a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[110835e3-28ee-4e22-b6ff-9019033c44d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b9fd6-1ee3-4924-a2e4-01ad01fba5fa]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:29:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] Acquiring lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] No waiting events found dispatching network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:12 user nova-compute[74932]: WARNING nova.compute.manager [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received unexpected event network-vif-plugged-348c7c87-85a8-41e6-a214-6170a5b2d721 for instance with vm_state active and task_state deleting.
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing instance network info cache due to event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] <== connect_volume: return (1679ms) {'type': 'block', 'scsi_wwn': '26436623537643865', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436623537643865', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-420698720',display_name='tempest-TestShelveInstance-server-420698720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-420698720',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-110969466',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e73625a0f392447c80d434d24b8218eb',ramdisk_id='',reservation_id='r-tw8lmu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1221651483',owner_user_name='tempest-TestShelveInstance-1221651483-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:28:46Z,user_data=None,user_id='dc9effb60d8447f199761e316876ca81',uuid=d8e7e5d7-df88-4470-99f7-24f015dcf32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converting VIF {"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.objects.instance [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.objects.base [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Object Instance<d8e7e5d7-df88-4470-99f7-24f015dcf32a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:29:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:29:12 user nova-compute[74932]:   <uuid>d8e7e5d7-df88-4470-99f7-24f015dcf32a</uuid>
Nov 03 16:29:12 user nova-compute[74932]:   <name>instance-0000000b</name>
Nov 03 16:29:12 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:29:12 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:29:12 user nova-compute[74932]:   <metadata>
Nov 03 16:29:12 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:29:12 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:29:12 user nova-compute[74932]:       <nova:name>tempest-TestShelveInstance-server-420698720</nova:name>
Nov 03 16:29:12 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:29:11</nova:creationTime>
Nov 03 16:29:12 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:29:12 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:29:12 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:29:12 user nova-compute[74932]:       <nova:owner>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:user uuid="dc9effb60d8447f199761e316876ca81">tempest-TestShelveInstance-1221651483-project-member</nova:user>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:project uuid="e73625a0f392447c80d434d24b8218eb">tempest-TestShelveInstance-1221651483</nova:project>
Nov 03 16:29:12 user nova-compute[74932]:       </nova:owner>
Nov 03 16:29:12 user nova-compute[74932]:       <nova:ports>
Nov 03 16:29:12 user nova-compute[74932]:         <nova:port uuid="102e231c-e02f-4a02-8534-e22a3c48f0e8">
Nov 03 16:29:12 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 16:29:12 user nova-compute[74932]:         </nova:port>
Nov 03 16:29:12 user nova-compute[74932]:       </nova:ports>
Nov 03 16:29:12 user nova-compute[74932]:     </nova:instance>
Nov 03 16:29:12 user nova-compute[74932]:   </metadata>
Nov 03 16:29:12 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:29:12 user nova-compute[74932]:     <system>
Nov 03 16:29:12 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:29:12 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:29:12 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:29:12 user nova-compute[74932]:       <entry name="serial">d8e7e5d7-df88-4470-99f7-24f015dcf32a</entry>
Nov 03 16:29:12 user nova-compute[74932]:       <entry name="uuid">d8e7e5d7-df88-4470-99f7-24f015dcf32a</entry>
Nov 03 16:29:12 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:29:12 user nova-compute[74932]:     </system>
Nov 03 16:29:12 user nova-compute[74932]:   </sysinfo>
Nov 03 16:29:12 user nova-compute[74932]:   <os>
Nov 03 16:29:12 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:29:12 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:29:12 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:29:12 user nova-compute[74932]:   </os>
Nov 03 16:29:12 user nova-compute[74932]:   <features>
Nov 03 16:29:12 user nova-compute[74932]:     <acpi/>
Nov 03 16:29:12 user nova-compute[74932]:     <apic/>
Nov 03 16:29:12 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:29:12 user nova-compute[74932]:   </features>
Nov 03 16:29:12 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:29:12 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:29:12 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:29:12 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:29:12 user nova-compute[74932]:   </clock>
Nov 03 16:29:12 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:29:12 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:29:12 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:29:12 user nova-compute[74932]:   </cpu>
Nov 03 16:29:12 user nova-compute[74932]:   <devices>
Nov 03 16:29:12 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:29:12 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:29:12 user nova-compute[74932]:       <source dev="/dev/sdb"/>
Nov 03 16:29:12 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:29:12 user nova-compute[74932]:       <serial>35980f7b-8727-4640-b188-99ed55d44a60</serial>
Nov 03 16:29:12 user nova-compute[74932]:     </disk>
Nov 03 16:29:12 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:29:12 user nova-compute[74932]:       <mac address="fa:16:3e:35:1b:03"/>
Nov 03 16:29:12 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:29:12 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:29:12 user nova-compute[74932]:       <target dev="tap102e231c-e0"/>
Nov 03 16:29:12 user nova-compute[74932]:     </interface>
Nov 03 16:29:12 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:29:12 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a/console.log" append="off"/>
Nov 03 16:29:12 user nova-compute[74932]:     </serial>
Nov 03 16:29:12 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:29:12 user nova-compute[74932]:     <video>
Nov 03 16:29:12 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:29:12 user nova-compute[74932]:     </video>
Nov 03 16:29:12 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:29:12 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:29:12 user nova-compute[74932]:     </rng>
Nov 03 16:29:12 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:29:12 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:29:12 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:29:12 user nova-compute[74932]:     </memballoon>
Nov 03 16:29:12 user nova-compute[74932]:   </devices>
Nov 03 16:29:12 user nova-compute[74932]: </domain>
Nov 03 16:29:12 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-420698720',display_name='tempest-TestShelveInstance-server-420698720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-420698720',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-110969466',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e73625a0f392447c80d434d24b8218eb',ramdisk_id='',reservation_id='r-tw8lmu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1221651483',owner_user_name='tempest-TestShelveInstance-1221651483-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:28:46Z,user_data=None,user_id='dc9effb60d8447f199761e316876ca81',uuid=d8e7e5d7-df88-4470-99f7-24f015dcf32a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converting VIF {"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG os_vif [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea9d1325-ae4d-54fe-91ab-5f14631d1b0b', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap102e231c-e0, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap102e231c-e0, col_values=(('qos', UUID('99f450e0-3346-4bec-bc69-1a8765252d37')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap102e231c-e0, col_values=(('external_ids', {'iface-id': '102e231c-e02f-4a02-8534-e22a3c48f0e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:1b:03', 'vm-uuid': 'd8e7e5d7-df88-4470-99f7-24f015dcf32a'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:13 user nova-compute[74932]: INFO os_vif [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0')
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] No VIF found with MAC fa:16:3e:35:1b:03, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updated VIF entry in instance network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c3805139-d178-46e0-b0a6-57375c0ac19e req-11480103-e57b-4bce-8fe7-89270ca97f51 service nova] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-deleted-a20486a5-f54d-4f05-828d-dfbc6b0cb66d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:14 user nova-compute[74932]: INFO nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Neutron deleted interface a20486a5-f54d-4f05-828d-dfbc6b0cb66d; detaching it from the instance and deleting it from the info cache
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61357ead-7a4e-4809-8640-dbf23410df4f", "address": "fa:16:3e:c7:bd:49", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61357ead-7a", "ovs_interfaceid": "61357ead-7a4e-4809-8640-dbf23410df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Detach interface failed, port_id=a20486a5-f54d-4f05-828d-dfbc6b0cb66d, reason: Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-deleted-61357ead-7a4e-4809-8640-dbf23410df4f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:14 user nova-compute[74932]: INFO nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Neutron deleted interface 61357ead-7a4e-4809-8640-dbf23410df4f; detaching it from the instance and deleting it from the info cache
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "address": "fa:16:3e:0a:d7:de", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfd246d-a0", "ovs_interfaceid": "0bfd246d-a03a-4e06-9e68-499e2ce5c73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Detach interface failed, port_id=61357ead-7a4e-4809-8640-dbf23410df4f, reason: Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-deleted-0bfd246d-a03a-4e06-9e68-499e2ce5c73e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:14 user nova-compute[74932]: INFO nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Neutron deleted interface 0bfd246d-a03a-4e06-9e68-499e2ce5c73e; detaching it from the instance and deleting it from the info cache
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [{"id": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "address": "fa:16:3e:d6:4b:c0", "network": {"id": "551c08ed-b1e9-4e2d-84c5-33734dd00448", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-175578731-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5008f1b-51", "ovs_interfaceid": "f5008f1b-5165-4d01-823e-4d4c3fc4d5cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2507f374-275d-4c75-8a34-64a9e36eed8d", "address": "fa:16:3e:95:1b:26", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2507f374-27", "ovs_interfaceid": "2507f374-275d-4c75-8a34-64a9e36eed8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "address": "fa:16:3e:4d:7d:c2", "network": {"id": "5276cd63-18fd-4679-8ec6-06d9ed677616", "bridge": "br-int", "label": "tempest-device-tagging-net1-103730939", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4d454e-94", "ovs_interfaceid": "5f4d454e-94c1-4e7c-bef9-6f76d5d8d10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "348c7c87-85a8-41e6-a214-6170a5b2d721", "address": "fa:16:3e:1c:6b:ed", "network": {"id": "8e9dc27a-10f4-4fb6-9b59-42c9f003f6d7", "bridge": "br-int", "label": "tempest-device-tagging-net2-1891830022", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11d7e1c111a34d35930b25a5357ae5db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap348c7c87-85", "ovs_interfaceid": "348c7c87-85a8-41e6-a214-6170a5b2d721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-46379c89-3c87-4faf-8ea9-1a163573a2d3 req-0378ca2a-2ba2-4083-92c5-99085fe4e1d6 service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Detach interface failed, port_id=0bfd246d-a03a-4e06-9e68-499e2ce5c73e, reason: Instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-28a65049-37fa-482a-83f6-bebbe996c093 req-ba7216cb-0851-41a9-9a9b-752fcd92898f service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-28a65049-37fa-482a-83f6-bebbe996c093 req-ba7216cb-0851-41a9-9a9b-752fcd92898f service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-28a65049-37fa-482a-83f6-bebbe996c093 req-ba7216cb-0851-41a9-9a9b-752fcd92898f service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-28a65049-37fa-482a-83f6-bebbe996c093 req-ba7216cb-0851-41a9-9a9b-752fcd92898f service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-28a65049-37fa-482a-83f6-bebbe996c093 req-ba7216cb-0851-41a9-9a9b-752fcd92898f service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:14 user nova-compute[74932]: WARNING nova.compute.manager [req-28a65049-37fa-482a-83f6-bebbe996c093 req-ba7216cb-0851-41a9-9a9b-752fcd92898f service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 16:29:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:15 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:15 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Took 4.21 seconds to deallocate network for instance.
Nov 03 16:29:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-ce18ba83-7ff0-417b-b4b6-a5d3e615525f req-9c83a2f8-f1cc-4cbf-bb2b-fbe333bef1ab service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-deleted-f5008f1b-5165-4d01-823e-4d4c3fc4d5cc {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-ce18ba83-7ff0-417b-b4b6-a5d3e615525f req-9c83a2f8-f1cc-4cbf-bb2b-fbe333bef1ab service nova] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Received event network-vif-deleted-348c7c87-85a8-41e6-a214-6170a5b2d721 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-3e0d2d8b-7aa5-49ae-81a6-a56f0566613b req-2e279051-d62b-48ba-85c5-4f70357f01de service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3e0d2d8b-7aa5-49ae-81a6-a56f0566613b req-2e279051-d62b-48ba-85c5-4f70357f01de service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3e0d2d8b-7aa5-49ae-81a6-a56f0566613b req-2e279051-d62b-48ba-85c5-4f70357f01de service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3e0d2d8b-7aa5-49ae-81a6-a56f0566613b req-2e279051-d62b-48ba-85c5-4f70357f01de service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-3e0d2d8b-7aa5-49ae-81a6-a56f0566613b req-2e279051-d62b-48ba-85c5-4f70357f01de service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:16 user nova-compute[74932]: WARNING nova.compute.manager [req-3e0d2d8b-7aa5-49ae-81a6-a56f0566613b req-2e279051-d62b-48ba-85c5-4f70357f01de service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:29:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance spawned successfully.
Nov 03 16:29:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:29:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-17eca314-c5de-48e7-948a-609da491dff1 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.396s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:19 user nova-compute[74932]: INFO nova.compute.manager [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] [instance: caf006bb-ea6d-4d96-a6d6-dd9cb51cd072] Took 3.12 seconds to detach 3 volumes for instance.
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:19 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Deleted allocations for instance caf006bb-ea6d-4d96-a6d6-dd9cb51cd072
Nov 03 16:29:19 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 is timed out.
Nov 03 16:29:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully detached device vdc from instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 from the live domain config.
Nov 03 16:29:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geGLqxsv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:19 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d33daf51-ca2d-4bc5-86b4-17b92d5ae60f tempest-TaggedBootDevicesTest-47404985 tempest-TaggedBootDevicesTest-47404985-project-member] Lock "caf006bb-ea6d-4d96-a6d6-dd9cb51cd072" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.958s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e86e5-e4a2-467d-a816-5249d3efae84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:29:19 user nova-compute[74932]: No targets found.
Nov 03 16:29:19 user nova-compute[74932]: iSNS:
Nov 03 16:29:19 user nova-compute[74932]: No targets found.
Nov 03 16:29:19 user nova-compute[74932]: STATIC:
Nov 03 16:29:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:29:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:29:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:29:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:19 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8
Nov 03 16:29:19 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:19 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:19 user nova-compute[74932]: FIRMWARE:
Nov 03 16:29:19 user nova-compute[74932]: No targets found.
Nov 03 16:29:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:29:19 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:29:19 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f936460-ca85-4bbe-be65-9aa08c74fb60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a590a-60f9-4fcb-ab44-d07baa1c58cf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:19 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:19 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:19 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 (non-flash)
Nov 03 16:29:19 user nova-compute[74932]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:19 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:19 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6449add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beeba74-b14d-4f18-98ca-a0b0391b52cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b69820-1250-4229-a884-c3c781ad7af6]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a121fc-9512-4125-94da-f0b0b5af4048]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a173291-ddb8-49c6-a672-053b08bf6ecf]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c521e3e-7098-4b1a-a2e0-c71d8a5db20b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[547be0cc-5660-4421-9aec-ebfcda21b1ec]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260]
Nov 03 16:29:20 user nova-compute[74932]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c49daba7-6951-4cac-9b1d-bafe28733fd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[694b9a7a-896d-41e3-a076-ff075cda3b49]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] <== disconnect_volume: return (371ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:29:21 user nova-compute[74932]: DEBUG nova.objects.instance [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'flavor' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-762a4208-5e41-4f6b-9174-e6982e6e2e70 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.072s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.555s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:39 user nova-compute[74932]: INFO nova.compute.manager [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Terminating instance
Nov 03 16:29:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-1d7b4498-9f0c-45b0-a8a5-5188372fa6c2 req-b2c1f2de-9a9a-44f3-8cc7-079500f196f8 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-unplugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1d7b4498-9f0c-45b0-a8a5-5188372fa6c2 req-b2c1f2de-9a9a-44f3-8cc7-079500f196f8 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1d7b4498-9f0c-45b0-a8a5-5188372fa6c2 req-b2c1f2de-9a9a-44f3-8cc7-079500f196f8 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1d7b4498-9f0c-45b0-a8a5-5188372fa6c2 req-b2c1f2de-9a9a-44f3-8cc7-079500f196f8 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-1d7b4498-9f0c-45b0-a8a5-5188372fa6c2 req-b2c1f2de-9a9a-44f3-8cc7-079500f196f8 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-unplugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-1d7b4498-9f0c-45b0-a8a5-5188372fa6c2 req-b2c1f2de-9a9a-44f3-8cc7-079500f196f8 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-unplugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Instance destroyed successfully.
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.objects.instance [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'resources' on Instance uuid a06239ec-5943-4ca5-a9f8-5421c3a6528d {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-365318984',display_name='tempest-VolumesAdminNegativeTest-server-365318984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-365318984',id=13,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb89089043442b980d4d230bb608ad6',ramdisk_id='',reservation_id='r-7p45xafp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-164723280',owner_user_name='tempest-VolumesAdminNegativeTest-164723280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:16Z,user_data=None,user_id='21f75f8149b74615b3a1e3cf77de2d5e',uuid=a06239ec-5943-4ca5-a9f8-5421c3a6528d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converting VIF {"id": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "address": "fa:16:3e:96:ff:cf", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0908e8a0-0a", "ovs_interfaceid": "0908e8a0-0a0c-45cc-be06-8334aae599ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG os_vif [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0908e8a0-0a, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=382430fc-b714-4fdc-ad85-7f6f4b3ab605) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: INFO os_vif [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ff:cf,bridge_name='br-int',has_traffic_filtering=True,id=0908e8a0-0a0c-45cc-be06-8334aae599ad,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0908e8a0-0a')
Nov 03 16:29:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Deleting instance files /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d_del
Nov 03 16:29:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Deletion of /opt/stack/data/nova/instances/a06239ec-5943-4ca5-a9f8-5421c3a6528d_del complete
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: INFO nova.compute.manager [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 03 16:29:40 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:40 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Took 0.50 seconds to deallocate network for instance.
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-e0fd70ae-5027-46fe-8032-2b57a8d1fba0 req-bc161662-4efd-4e87-9348-fbf1fabe0068 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-deleted-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:40 user nova-compute[74932]: INFO nova.compute.manager [req-e0fd70ae-5027-46fe-8032-2b57a8d1fba0 req-bc161662-4efd-4e87-9348-fbf1fabe0068 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Neutron deleted interface 0908e8a0-0a0c-45cc-be06-8334aae599ad; detaching it from the instance and deleting it from the info cache
Nov 03 16:29:40 user nova-compute[74932]: DEBUG nova.network.neutron [req-e0fd70ae-5027-46fe-8032-2b57a8d1fba0 req-bc161662-4efd-4e87-9348-fbf1fabe0068 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-e0fd70ae-5027-46fe-8032-2b57a8d1fba0 req-bc161662-4efd-4e87-9348-fbf1fabe0068 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Detach interface failed, port_id=0908e8a0-0a0c-45cc-be06-8334aae599ad, reason: Instance a06239ec-5943-4ca5-a9f8-5421c3a6528d could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Deleted allocations for instance a06239ec-5943-4ca5-a9f8-5421c3a6528d
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-55bd9c57-94cc-4770-bb24-16f3402289a6 tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:41 user nova-compute[74932]: WARNING nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state deleted and task_state None.
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:41 user nova-compute[74932]: WARNING nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state deleted and task_state None.
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:41 user nova-compute[74932]: WARNING nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state deleted and task_state None.
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-unplugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-unplugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:41 user nova-compute[74932]: WARNING nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-unplugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state deleted and task_state None.
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Acquiring lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] Lock "a06239ec-5943-4ca5-a9f8-5421c3a6528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] No waiting events found dispatching network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:41 user nova-compute[74932]: WARNING nova.compute.manager [req-ad8fa708-9c7e-4955-bad2-f7d3f7f164a8 req-2b68c200-dc14-4668-8494-531cf3d961e9 service nova] [instance: a06239ec-5943-4ca5-a9f8-5421c3a6528d] Received unexpected event network-vif-plugged-0908e8a0-0a0c-45cc-be06-8334aae599ad for instance with vm_state deleted and task_state None.
Nov 03 16:29:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:29:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:29:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:29:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:29:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:29:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:29:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:44 user nova-compute[74932]: INFO nova.compute.manager [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Terminating instance
Nov 03 16:29:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-bed90754-1918-4d7c-b9f3-44eda6e6e6ea req-dc876082-0580-446e-8620-c091b0285216 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-vif-unplugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bed90754-1918-4d7c-b9f3-44eda6e6e6ea req-dc876082-0580-446e-8620-c091b0285216 service nova] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bed90754-1918-4d7c-b9f3-44eda6e6e6ea req-dc876082-0580-446e-8620-c091b0285216 service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bed90754-1918-4d7c-b9f3-44eda6e6e6ea req-dc876082-0580-446e-8620-c091b0285216 service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-bed90754-1918-4d7c-b9f3-44eda6e6e6ea req-dc876082-0580-446e-8620-c091b0285216 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] No waiting events found dispatching network-vif-unplugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-bed90754-1918-4d7c-b9f3-44eda6e6e6ea req-dc876082-0580-446e-8620-c091b0285216 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-vif-unplugged-dccc0acb-ffa9-4417-bdf3-445b09723240 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: be942262-61f1-452b-bda1-5185b321477b] Instance destroyed successfully.
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lazy-loading 'resources' on Instance uuid be942262-61f1-452b-bda1-5185b321477b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-326517297',display_name='tempest-TestVolumeSwap-server-326517297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-326517297',id=6,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhF/CaENgrOF50x8+oquDtYy2wHP0n7LfWpuvfSWUcPoxLshSpd+VQ8pyYktRA7ZvvGIIjmU0lQehdR1i+Whqy2ya+Tl7WsaRPW/eI4TDIgDtaHp0cG0OhLOddjkW7Qfg==',key_name='tempest-keypair-592199101',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17204819840482d90ec72ef703b2eea',ramdisk_id='',reservation_id='r-3rbp77rh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-220001656',owner_user_name='tempest-TestVolumeSwap-220001656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:23:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cce04e168f2f441fa42c0e7c75c72e17',uuid=be942262-61f1-452b-bda1-5185b321477b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Converting VIF {"id": "dccc0acb-ffa9-4417-bdf3-445b09723240", "address": "fa:16:3e:8e:98:92", "network": {"id": "7184a398-7cc9-4427-90a6-f8d04acffca1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-64794822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17204819840482d90ec72ef703b2eea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccc0acb-ff", "ovs_interfaceid": "dccc0acb-ffa9-4417-bdf3-445b09723240", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_vif [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdccc0acb-ff, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a486c3e7-4012-421c-b461-58866bead5d5) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:45 user nova-compute[74932]: INFO os_vif [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:98:92,bridge_name='br-int',has_traffic_filtering=True,id=dccc0acb-ffa9-4417-bdf3-445b09723240,network=Network(7184a398-7cc9-4427-90a6-f8d04acffca1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccc0acb-ff')
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCxUfBcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'fa584ebb-400a-4e36-8901-fce6b8cd3179'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:45 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c631f0-fee6-4af4-b495-c1bb3a91d49a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:29:45 user nova-compute[74932]: No targets found.
Nov 03 16:29:45 user nova-compute[74932]: iSNS:
Nov 03 16:29:45 user nova-compute[74932]: No targets found.
Nov 03 16:29:45 user nova-compute[74932]: STATIC:
Nov 03 16:29:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179
Nov 03 16:29:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:29:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:29:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:45 user nova-compute[74932]: FIRMWARE:
Nov 03 16:29:45 user nova-compute[74932]: No targets found.
Nov 03 16:29:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:29:45 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:29:45 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98b6281-b975-4bfd-9b5c-bf397f21c78d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336ebf1-cfb9-4a7f-bb3d-7e14a013cd3d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:45 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:45 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:45 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:45 user nova-compute[74932]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 (non-flash)
Nov 03 16:29:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645b2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179'): ({'sdh'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Removing single pathed devices sdh {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc16a66-28b4-4884-a4af-f37c79e958b0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a516f30-ac96-4852-9a0f-3a159210914a]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Flushing IO for device /dev/sdh {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80acfc9-3d7b-442a-bd42-9e5e7feec420]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e545c-2b7b-438a-bbca-90ce3798a3a8]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] SCSI volumes sdh have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a05be8a-8afc-47e4-940c-16692824d07d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[322daeee-2ff3-4e82-94bc-15819de3a771]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260]
Nov 03 16:29:45 user nova-compute[74932]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa584ebb-400a-4e36-8901-fce6b8cd3179 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[036963d5-f127-4007-a76c-bb3681b64962]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] <== disconnect_volume: return (325ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:29:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Deleting instance files /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b_del
Nov 03 16:29:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Deletion of /opt/stack/data/nova/instances/be942262-61f1-452b-bda1-5185b321477b_del complete
Nov 03 16:29:45 user nova-compute[74932]: INFO nova.compute.manager [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: be942262-61f1-452b-bda1-5185b321477b] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: be942262-61f1-452b-bda1-5185b321477b] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:46 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: be942262-61f1-452b-bda1-5185b321477b] Took 0.75 seconds to deallocate network for instance.
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-2fbd8624-e7fc-43b0-8fe2-78c2c7a30c75 req-0f16acb7-0d27-4957-a521-7952c77233a5 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-vif-deleted-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:46 user nova-compute[74932]: INFO nova.compute.manager [req-2fbd8624-e7fc-43b0-8fe2-78c2c7a30c75 req-0f16acb7-0d27-4957-a521-7952c77233a5 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Neutron deleted interface dccc0acb-ffa9-4417-bdf3-445b09723240; detaching it from the instance and deleting it from the info cache
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-2fbd8624-e7fc-43b0-8fe2-78c2c7a30c75 req-0f16acb7-0d27-4957-a521-7952c77233a5 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-2fbd8624-e7fc-43b0-8fe2-78c2c7a30c75 req-0f16acb7-0d27-4957-a521-7952c77233a5 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Detach interface failed, port_id=dccc0acb-ffa9-4417-bdf3-445b09723240, reason: Instance be942262-61f1-452b-bda1-5185b321477b could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-8868490f-e24f-4303-9b3b-68e3ee8629bd req-836f22a1-02b8-4036-8c5a-603db4158303 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received event network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8868490f-e24f-4303-9b3b-68e3ee8629bd req-836f22a1-02b8-4036-8c5a-603db4158303 service nova] Acquiring lock "be942262-61f1-452b-bda1-5185b321477b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8868490f-e24f-4303-9b3b-68e3ee8629bd req-836f22a1-02b8-4036-8c5a-603db4158303 service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8868490f-e24f-4303-9b3b-68e3ee8629bd req-836f22a1-02b8-4036-8c5a-603db4158303 service nova] Lock "be942262-61f1-452b-bda1-5185b321477b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-8868490f-e24f-4303-9b3b-68e3ee8629bd req-836f22a1-02b8-4036-8c5a-603db4158303 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] No waiting events found dispatching network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:46 user nova-compute[74932]: WARNING nova.compute.manager [req-8868490f-e24f-4303-9b3b-68e3ee8629bd req-836f22a1-02b8-4036-8c5a-603db4158303 service nova] [instance: be942262-61f1-452b-bda1-5185b321477b] Received unexpected event network-vif-plugged-dccc0acb-ffa9-4417-bdf3-445b09723240 for instance with vm_state active and task_state deleting.
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:47 user nova-compute[74932]: INFO nova.compute.manager [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] [instance: be942262-61f1-452b-bda1-5185b321477b] Took 0.90 seconds to detach 1 volumes for instance.
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:47 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Deleted allocations for instance be942262-61f1-452b-bda1-5185b321477b
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ebc50de8-f071-4c3e-b99b-e28c98afb892 tempest-TestVolumeSwap-220001656 tempest-TestVolumeSwap-220001656-project-member] Lock "be942262-61f1-452b-bda1-5185b321477b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.558s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:29:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:29:49 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:29:49 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.45444107055664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:49 user nova-compute[74932]: INFO nova.compute.manager [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Terminating instance
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Applying migration context for instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 as it has an incoming, in-progress migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e. Migration status is finished {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 16:29:49 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating resource usage from migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e
Nov 03 16:29:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e28e1da8-57bb-4116-8379-283afd127d01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1b97e423-b373-4f86-8ad7-281b30af23ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d8e7e5d7-df88-4470-99f7-24f015dcf32a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-598499e5-59f2-4f68-b7db-0c7de6f3e264 req-795ab5b7-b7ca-46a9-9472-1b0ccd10c6d6 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-unplugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-598499e5-59f2-4f68-b7db-0c7de6f3e264 req-795ab5b7-b7ca-46a9-9472-1b0ccd10c6d6 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-598499e5-59f2-4f68-b7db-0c7de6f3e264 req-795ab5b7-b7ca-46a9-9472-1b0ccd10c6d6 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-598499e5-59f2-4f68-b7db-0c7de6f3e264 req-795ab5b7-b7ca-46a9-9472-1b0ccd10c6d6 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-598499e5-59f2-4f68-b7db-0c7de6f3e264 req-795ab5b7-b7ca-46a9-9472-1b0ccd10c6d6 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-unplugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-598499e5-59f2-4f68-b7db-0c7de6f3e264 req-795ab5b7-b7ca-46a9-9472-1b0ccd10c6d6 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-unplugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Instance destroyed successfully.
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'resources' on Instance uuid 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:22:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1869007814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1869007814',id=2,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmRIEWkvnhfWBt9oMf696eo2xeNdm00BGflZzefY/+obY9+I9ANGBdmGwFI0a77BskqR999jg/4fFbW++fyYLZHccvBY8rwrABCqJwA+E9VxffX4qIlgdv/EMbjlWBkqQ==',key_name='tempest-keypair-271065144',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-me8mqfb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:27:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=0238b778-b9e2-4a5b-82f2-5d58a6a552e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "address": "fa:16:3e:39:ca:4b", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0caef5-f0", "ovs_interfaceid": "7d0caef5-f058-4eca-b838-2cf6bf7cae2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG os_vif [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d0caef5-f0, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ae56ac6-49ae-4f4e-b175-bbc40017f253) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:50 user nova-compute[74932]: INFO os_vif [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ca:4b,bridge_name='br-int',has_traffic_filtering=True,id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0caef5-f0')
Nov 03 16:29:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Deleting instance files /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7_del
Nov 03 16:29:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Deletion of /opt/stack/data/nova/instances/0238b778-b9e2-4a5b-82f2-5d58a6a552e7_del complete
Nov 03 16:29:50 user nova-compute[74932]: INFO nova.compute.manager [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 16:29:50 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:29:50 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:51 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Took 0.75 seconds to deallocate network for instance.
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-80639026-9ca8-4e93-b46d-4e830b1d06b7 req-64048506-d929-4459-8945-0b58ee4fa4af service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-deleted-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:51 user nova-compute[74932]: INFO nova.compute.manager [req-80639026-9ca8-4e93-b46d-4e830b1d06b7 req-64048506-d929-4459-8945-0b58ee4fa4af service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Neutron deleted interface 7d0caef5-f058-4eca-b838-2cf6bf7cae2d; detaching it from the instance and deleting it from the info cache
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.network.neutron [req-80639026-9ca8-4e93-b46d-4e830b1d06b7 req-64048506-d929-4459-8945-0b58ee4fa4af service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-80639026-9ca8-4e93-b46d-4e830b1d06b7 req-64048506-d929-4459-8945-0b58ee4fa4af service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Detach interface failed, port_id=7d0caef5-f058-4eca-b838-2cf6bf7cae2d, reason: Instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:51 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Deleted allocations for instance 0238b778-b9e2-4a5b-82f2-5d58a6a552e7
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-96bee4b8-9d19-4d26-a7cc-090e6f0c6f27 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-c677b350-8f00-41f3-b947-5f218cef15c5 req-151bc300-8f43-40fe-a57c-46dd341f9ca4 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c677b350-8f00-41f3-b947-5f218cef15c5 req-151bc300-8f43-40fe-a57c-46dd341f9ca4 service nova] Acquiring lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c677b350-8f00-41f3-b947-5f218cef15c5 req-151bc300-8f43-40fe-a57c-46dd341f9ca4 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c677b350-8f00-41f3-b947-5f218cef15c5 req-151bc300-8f43-40fe-a57c-46dd341f9ca4 service nova] Lock "0238b778-b9e2-4a5b-82f2-5d58a6a552e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-c677b350-8f00-41f3-b947-5f218cef15c5 req-151bc300-8f43-40fe-a57c-46dd341f9ca4 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] No waiting events found dispatching network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:51 user nova-compute[74932]: WARNING nova.compute.manager [req-c677b350-8f00-41f3-b947-5f218cef15c5 req-151bc300-8f43-40fe-a57c-46dd341f9ca4 service nova] [instance: 0238b778-b9e2-4a5b-82f2-5d58a6a552e7] Received unexpected event network-vif-plugged-7d0caef5-f058-4eca-b838-2cf6bf7cae2d for instance with vm_state deleted and task_state None.
Nov 03 16:29:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:29:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Port 7ab56479-82d0-433f-a971-d25a3edff1ed binding to destination host user is already ACTIVE {{(pid=74932) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 16:29:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:29:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:29:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Creating tmpfile /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/tmp7rg8cgwz to verify with other compute node that the instance is on the same shared storage. {{(pid=74932) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-a0417d49-4486-48fa-af46-e1a9f5954e9a req-dafd0f5e-8ab2-41d4-a1ad-09af843dd1c0 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a0417d49-4486-48fa-af46-e1a9f5954e9a req-dafd0f5e-8ab2-41d4-a1ad-09af843dd1c0 service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a0417d49-4486-48fa-af46-e1a9f5954e9a req-dafd0f5e-8ab2-41d4-a1ad-09af843dd1c0 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a0417d49-4486-48fa-af46-e1a9f5954e9a req-dafd0f5e-8ab2-41d4-a1ad-09af843dd1c0 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-a0417d49-4486-48fa-af46-e1a9f5954e9a req-dafd0f5e-8ab2-41d4-a1ad-09af843dd1c0 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:54 user nova-compute[74932]: WARNING nova.compute.manager [req-a0417d49-4486-48fa-af46-e1a9f5954e9a req-dafd0f5e-8ab2-41d4-a1ad-09af843dd1c0 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state resized and task_state resize_reverting.
Nov 03 16:29:55 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance destroyed successfully.
Nov 03 16:29:55 user nova-compute[74932]: DEBUG nova.objects.instance [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'resources' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ab56479-82, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=419a040a-5fc1-455d-8ce1-11ca627c1d03) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:55 user nova-compute[74932]: INFO os_vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82')
Nov 03 16:29:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:55 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[17824b2f-7f57-41f0-827c-a56dab839d55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:29:55 user nova-compute[74932]: No targets found.
Nov 03 16:29:55 user nova-compute[74932]: iSNS:
Nov 03 16:29:55 user nova-compute[74932]: No targets found.
Nov 03 16:29:55 user nova-compute[74932]: STATIC:
Nov 03 16:29:55 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:29:55 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:55 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:55 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:29:55 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:29:55 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:29:55 user nova-compute[74932]: FIRMWARE:
Nov 03 16:29:55 user nova-compute[74932]: No targets found.
Nov 03 16:29:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:29:55 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:29:55 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1174ded4-dab2-4f37-b891-e06c381d5a42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7edd071-d501-4f17-b366-3fc3bf1eddcd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:55 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:29:55 user nova-compute[74932]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:29:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6432a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f'): ({'sdf'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Removing single pathed devices sdf {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1cd2d-39d1-4295-8524-2264dcd04107]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a12ae9-4676-4d7f-8f8a-c1b8ae42884e]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flushing IO for device /dev/sdf {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5692de-a46e-4a20-a96a-f53500fc06ab]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8066d-4861-4f36-81e8-00231a3a89c2]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] SCSI volumes sdf have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a966ac5b-a5e3-4db8-ad37-6c6067e69456]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95882ac-d939-44cd-a8f9-c33f5af35f85]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]
Nov 03 16:29:55 user nova-compute[74932]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.
Nov 03 16:29:55 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[685bb6e6-3d6a-4a2a-b102-88b1ae4bc165]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== disconnect_volume: return (271ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:29:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG nova.objects.instance [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'migration_context' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG nova.objects.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Object Instance<cb4bd028-91a8-489d-ab27-e5dc6d75a7b7> lazy-loaded attributes: resources,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-2b0f4abd-ba6c-4909-a827-0d7aea1cf276 req-9db1bf89-55a5-40f0-b58f-16eb06e30606 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2b0f4abd-ba6c-4909-a827-0d7aea1cf276 req-9db1bf89-55a5-40f0-b58f-16eb06e30606 service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2b0f4abd-ba6c-4909-a827-0d7aea1cf276 req-9db1bf89-55a5-40f0-b58f-16eb06e30606 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2b0f4abd-ba6c-4909-a827-0d7aea1cf276 req-9db1bf89-55a5-40f0-b58f-16eb06e30606 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-2b0f4abd-ba6c-4909-a827-0d7aea1cf276 req-9db1bf89-55a5-40f0-b58f-16eb06e30606 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:29:56 user nova-compute[74932]: WARNING nova.compute.manager [req-2b0f4abd-ba6c-4909-a827-0d7aea1cf276 req-9db1bf89-55a5-40f0-b58f-16eb06e30606 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state resized and task_state resize_reverting.
Nov 03 16:29:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.365s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:29:56 user nova-compute[74932]: INFO nova.compute.manager [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Swapping old allocation on dict_keys(['22f2cc45-aa29-4bc9-9ee7-6d401d382067']) held by migration 39aaf176-d477-4ddc-a753-1cfd7f10c80e for instance
Nov 03 16:29:57 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Overwriting current allocation {'allocations': {'22f2cc45-aa29-4bc9-9ee7-6d401d382067': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'e4a734f8e7b34fd1b14f878955a48490', 'user_id': 'bcd6f5749c77427883db867a8de18c2f', 'consumer_generation': 1} on consumer cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG os_brick.utils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e485b651-b356-4e9c-9080-77b78d0c7e44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e286b0ae-a8a4-4454-8c8e-441d97634c6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dff84e-6285-4945-8220-3caf0f482ed7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d78f3c-b5ba-44af-b16f-224cfa7e4a73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:29:57 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:29:57 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e9372-8b08-4d8a-9309-20c573751409]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:29:57 user nova-compute[74932]: DEBUG os_brick.utils [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-changed-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Refreshing instance network info cache due to event network-changed-960126c0-deac-4948-89c7-c42defe84a9f. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] Acquiring lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] Acquired lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Refreshing network info cache for port 960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updated VIF entry in instance network info cache for port 960126c0-deac-4948-89c7-c42defe84a9f. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:30:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating instance_info_cache with network_info: [{"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e58f57c-d0c0-4ca2-99ef-b1a3ab0c8435 req-d79a2374-0b27-4fe6-824c-bf51181c79dc service nova] Releasing lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:30:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:03 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:30:03 user nova-compute[74932]: INFO nova.compute.claims [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Claim successful on node user
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:30:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:30:04 user nova-compute[74932]: INFO nova.virt.block_device [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Booting with volume f4a8c616-f7d5-47a1-950e-f14740a88f88 at /dev/vda
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.policy [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64e88e0fca994117a979a0e664b01b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846c49ad0b704a60b8bc3b11cdaace79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG os_brick.utils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2680ef41-70b2-4b3c-97a9-33a9049f8d04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95c43d-cb00-4d9a-bc81-66365463379a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa18ae-7825-4ddd-af51-d0f715612bf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d496a9-040d-4493-91e2-0ab4fd2d409f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:04 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:30:04 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c051ef73-785b-4f4e-ae6e-eed92e3441fc]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG os_brick.utils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:04 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating existing volume attachment record: 872c4d6f-8de6-447e-a6e9-b5e4d63462ae {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:30:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:05 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully created port: 1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:05 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully created port: b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully created port: 4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully created port: da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully created port: 01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: 1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-1abb133f-d6e7-4993-a37b-abe7343e75b0. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port 1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:08 user nova-compute[74932]: DEBUG nova.network.neutron [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:09 user nova-compute[74932]: DEBUG nova.network.neutron [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7983bb72-8c2c-47c2-954e-5ed13be64e4e req-db5c90c5-4211-4203-82e7-7d8e18e111f5 service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: 4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port 4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-d4c7edf5-b485-4434-a7c3-4740df831df8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-b806163e-05c2-4c65-b7c6-9bd524d51962. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: 4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG nova.network.neutron [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c75ca14-784b-4ed2-9a60-2f4d6b90b16e req-dc0ca60e-0835-4dc0-a9d1-3df8a9f53b93 service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-da2d68a2-4bfd-494f-a06f-815126402456. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "e28e1da8-57bb-4116-8379-283afd127d01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-72c2c388-41e1-437c-8a7a-b62d16445bb1 req-8df2eb35-6a07-4976-a5c9-5d9688f4c49a service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:12 user nova-compute[74932]: INFO nova.compute.manager [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Terminating instance
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-4f833233-310c-4d46-90f5-24b22a340ba6. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port 4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6201f51e-2e36-4d80-8345-3db4a4dce150 req-c7360d54-9e67-43f9-bcbd-a9a71e6991c1 service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Instance destroyed successfully.
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.objects.instance [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lazy-loading 'resources' on Instance uuid e28e1da8-57bb-4116-8379-283afd127d01 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1447963520',display_name='tempest-VolumesActionsTest-instance-1447963520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1447963520',id=14,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab2a9f790bc64682a55a649f8587e758',ramdisk_id='',reservation_id='r-s0ethad0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1346474218',owner_user_name='tempest-VolumesActionsTest-1346474218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:28:00Z,user_data=None,user_id='5705e3f08090409592cb9f2349d073cb',uuid=e28e1da8-57bb-4116-8379-283afd127d01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Converting VIF {"id": "96e1243b-e485-47ac-96b3-d1af0598d2da", "address": "fa:16:3e:53:84:73", "network": {"id": "a5d01135-9df4-4f17-b7b3-79617b0733a1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1671520751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab2a9f790bc64682a55a649f8587e758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e1243b-e4", "ovs_interfaceid": "96e1243b-e485-47ac-96b3-d1af0598d2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG os_vif [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96e1243b-e4, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c318173-4405-4511-9616-6db8b474278c) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:13 user nova-compute[74932]: INFO os_vif [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:84:73,bridge_name='br-int',has_traffic_filtering=True,id=96e1243b-e485-47ac-96b3-d1af0598d2da,network=Network(a5d01135-9df4-4f17-b7b3-79617b0733a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96e1243b-e4')
Nov 03 16:30:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Deleting instance files /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01_del
Nov 03 16:30:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Deletion of /opt/stack/data/nova/instances/e28e1da8-57bb-4116-8379-283afd127d01_del complete
Nov 03 16:30:13 user nova-compute[74932]: INFO nova.compute.manager [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 03 16:30:13 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e28e1da8-57bb-4116-8379-283afd127d01] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Successfully updated port: 01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:14 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Took 0.49 seconds to deallocate network for instance.
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received event network-vif-unplugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] No waiting events found dispatching network-vif-unplugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:14 user nova-compute[74932]: WARNING nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received unexpected event network-vif-unplugged-96e1243b-e485-47ac-96b3-d1af0598d2da for instance with vm_state deleted and task_state None.
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received event network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Acquiring lock "e28e1da8-57bb-4116-8379-283afd127d01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Lock "e28e1da8-57bb-4116-8379-283afd127d01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] No waiting events found dispatching network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:14 user nova-compute[74932]: WARNING nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received unexpected event network-vif-plugged-96e1243b-e485-47ac-96b3-d1af0598d2da for instance with vm_state deleted and task_state None.
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-01e0d16c-3622-40ef-9fca-d86a087d7796. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:14 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Deleted allocations for instance e28e1da8-57bb-4116-8379-283afd127d01
Nov 03 16:30:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6a96c7d3-20d3-4eb8-ab63-c359e29d1930 tempest-VolumesActionsTest-1346474218 tempest-VolumesActionsTest-1346474218-project-member] Lock "e28e1da8-57bb-4116-8379-283afd127d01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-1851da16-786e-42df-99ea-6e40e90b4833 req-919d894a-4e5c-4f39-932a-1a91574dacee service nova] [instance: e28e1da8-57bb-4116-8379-283afd127d01] Received event network-vif-deleted-96e1243b-e485-47ac-96b3-d1af0598d2da {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG nova.network.neutron [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance network_info: |[{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port 01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updated VIF entry in instance network info cache for port 01e0d16c-3622-40ef-9fca-d86a087d7796. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b0e6549a-f84a-47b3-bdf3-b80bda0275f1 req-034993fe-187f-4c18-9454-3f1684a95811 service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 1b97e423-b373-4f86-8ad7-281b30af23ee {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:18 user nova-compute[74932]: INFO nova.compute.manager [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Attaching volume eabd348f-7d4f-4665-8417-d5610b6ff644 to /dev/vdb
Nov 03 16:30:18 user nova-compute[74932]: DEBUG os_brick.utils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[848dfc0a-c6c8-427c-a3ac-edd2883c9c0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[339f5401-8407-4088-a0ef-c8ee4cc27415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[911baebd-5ee1-4235-9a08-595d13714e28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5fc7a5-c945-4765-9d7e-9ec447a52e28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:18 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:30:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eaad2a-37c8-4164-ba78-a2180e58b7b4]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG os_brick.utils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:18 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating existing volume attachment record: 2a3f00ba-3578-43bf-8a44-89265eb4537b {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Starting finish_revert_migration {{(pid=74932) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start _get_guest_xml network_info=[{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cb4bd028-91a8-489d-ab27-e5dc6d75a7b7', 'attached_at': '2023-11-03T16:30:19.000000', 'detached_at': '', 'volume_id': '13b5fdcc-d757-449e-ae07-198e9d622b2f', 'serial': '13b5fdcc-d757-449e-ae07-198e9d622b2f'}, 'attachment_id': 'be40ef90-16e8-4923-8354-564e6d12da1d', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:30:19 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:30:19 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.objects.instance [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:30:19 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:30:19 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:30:19 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4daae2e-b8a3-45d5-a0d3-3c21ef9cb41d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:30:19 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35a369b-8971-400e-bb05-56391ab1a196]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f] added
Nov 03 16:30:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[baffe543-1255-4a14-8eb2-ee2bcb9119df]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b0f41-007a-4523-8bb3-3182338c45de]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETVOdxnp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETVOdxnp" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffca1445-6dd3-4e90-bc13-f5657ebf8c90]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETVOdxnp'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8f0fe6-091b-489f-8654-4e4b33efbee2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4c418-e28c-4814-af2f-b416db166dc9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:30:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:30:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca91b31-fe01-4423-afb5-0107bae7a8df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]
Nov 03 16:30:19 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.
Nov 03 16:30:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[59594ca4-e3d3-4111-bf54-b73097161113]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67dc65-a304-4a69-96c7-f8ab20b32415]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:30:19 user nova-compute[74932]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:30:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:30:19 user nova-compute[74932]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:30:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:30:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9182e6-a2b6-4772-aa1a-059c02e3de28]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:30:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23462386631663662', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462386631663662', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:30:21 user nova-compute[74932]:   <uuid>cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</uuid>
Nov 03 16:30:21 user nova-compute[74932]:   <name>instance-00000003</name>
Nov 03 16:30:21 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:30:21 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:30:21 user nova-compute[74932]:   <metadata>
Nov 03 16:30:21 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:30:21 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:30:21 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherB-server-103654683</nova:name>
Nov 03 16:30:21 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:30:19</nova:creationTime>
Nov 03 16:30:21 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:30:21 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:30:21 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:30:21 user nova-compute[74932]:       <nova:owner>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:user uuid="bcd6f5749c77427883db867a8de18c2f">tempest-ServerActionsTestOtherB-2075500504-project-member</nova:user>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:project uuid="e4a734f8e7b34fd1b14f878955a48490">tempest-ServerActionsTestOtherB-2075500504</nova:project>
Nov 03 16:30:21 user nova-compute[74932]:       </nova:owner>
Nov 03 16:30:21 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:30:21 user nova-compute[74932]:       <nova:ports>
Nov 03 16:30:21 user nova-compute[74932]:         <nova:port uuid="7ab56479-82d0-433f-a971-d25a3edff1ed">
Nov 03 16:30:21 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:30:21 user nova-compute[74932]:         </nova:port>
Nov 03 16:30:21 user nova-compute[74932]:       </nova:ports>
Nov 03 16:30:21 user nova-compute[74932]:     </nova:instance>
Nov 03 16:30:21 user nova-compute[74932]:   </metadata>
Nov 03 16:30:21 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:30:21 user nova-compute[74932]:     <system>
Nov 03 16:30:21 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:30:21 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:30:21 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:30:21 user nova-compute[74932]:       <entry name="serial">cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</entry>
Nov 03 16:30:21 user nova-compute[74932]:       <entry name="uuid">cb4bd028-91a8-489d-ab27-e5dc6d75a7b7</entry>
Nov 03 16:30:21 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:30:21 user nova-compute[74932]:     </system>
Nov 03 16:30:21 user nova-compute[74932]:   </sysinfo>
Nov 03 16:30:21 user nova-compute[74932]:   <os>
Nov 03 16:30:21 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:30:21 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:30:21 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:30:21 user nova-compute[74932]:   </os>
Nov 03 16:30:21 user nova-compute[74932]:   <features>
Nov 03 16:30:21 user nova-compute[74932]:     <acpi/>
Nov 03 16:30:21 user nova-compute[74932]:     <apic/>
Nov 03 16:30:21 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:30:21 user nova-compute[74932]:   </features>
Nov 03 16:30:21 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:30:21 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:30:21 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:30:21 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:30:21 user nova-compute[74932]:   </clock>
Nov 03 16:30:21 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:30:21 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:30:21 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:30:21 user nova-compute[74932]:   </cpu>
Nov 03 16:30:21 user nova-compute[74932]:   <devices>
Nov 03 16:30:21 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:30:21 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:30:21 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk"/>
Nov 03 16:30:21 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:30:21 user nova-compute[74932]:     </disk>
Nov 03 16:30:21 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:30:21 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:30:21 user nova-compute[74932]:       <source dev="/dev/sdc"/>
Nov 03 16:30:21 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:30:21 user nova-compute[74932]:       <serial>13b5fdcc-d757-449e-ae07-198e9d622b2f</serial>
Nov 03 16:30:21 user nova-compute[74932]:     </disk>
Nov 03 16:30:21 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:30:21 user nova-compute[74932]:       <mac address="fa:16:3e:d0:fa:36"/>
Nov 03 16:30:21 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:30:21 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:30:21 user nova-compute[74932]:       <target dev="tap7ab56479-82"/>
Nov 03 16:30:21 user nova-compute[74932]:     </interface>
Nov 03 16:30:21 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:30:21 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/console.log" append="off"/>
Nov 03 16:30:21 user nova-compute[74932]:     </serial>
Nov 03 16:30:21 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:30:21 user nova-compute[74932]:     <video>
Nov 03 16:30:21 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:30:21 user nova-compute[74932]:     </video>
Nov 03 16:30:21 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:30:21 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:30:21 user nova-compute[74932]:     </rng>
Nov 03 16:30:21 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:30:21 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:30:21 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:30:21 user nova-compute[74932]:     </memballoon>
Nov 03 16:30:21 user nova-compute[74932]:   </devices>
Nov 03 16:30:21 user nova-compute[74932]: </domain>
Nov 03 16:30:21 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:28:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG os_vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eb53e9d-7f4a-5fa6-aa92-27a931162e08', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ab56479-82, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ab56479-82, col_values=(('qos', UUID('592e3583-64cb-462f-8687-bf4649ac9970')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ab56479-82, col_values=(('external_ids', {'iface-id': '7ab56479-82d0-433f-a971-d25a3edff1ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fa:36', 'vm-uuid': 'cb4bd028-91a8-489d-ab27-e5dc6d75a7b7'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:21 user nova-compute[74932]: INFO os_vif [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82')
Nov 03 16:30:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-954ecf5e-6732-48df-9078-6b8a2d67836d req-08048556-7b3a-431c-97dc-d590352e1554 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-954ecf5e-6732-48df-9078-6b8a2d67836d req-08048556-7b3a-431c-97dc-d590352e1554 service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-954ecf5e-6732-48df-9078-6b8a2d67836d req-08048556-7b3a-431c-97dc-d590352e1554 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-954ecf5e-6732-48df-9078-6b8a2d67836d req-08048556-7b3a-431c-97dc-d590352e1554 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-954ecf5e-6732-48df-9078-6b8a2d67836d req-08048556-7b3a-431c-97dc-d590352e1554 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:22 user nova-compute[74932]: WARNING nova.compute.manager [req-954ecf5e-6732-48df-9078-6b8a2d67836d req-08048556-7b3a-431c-97dc-d590352e1554 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state resized and task_state resize_reverting.
Nov 03 16:30:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:30:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance running successfully.
Nov 03 16:30:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] finish_revert_migration finished successfully. {{(pid=74932) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 03 16:30:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f908824-7abc-41fa-bed7-dafe2c3495c3 req-a3a0d2bb-4a9c-42f8-b921-595d7de4add1 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f908824-7abc-41fa-bed7-dafe2c3495c3 req-a3a0d2bb-4a9c-42f8-b921-595d7de4add1 service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f908824-7abc-41fa-bed7-dafe2c3495c3 req-a3a0d2bb-4a9c-42f8-b921-595d7de4add1 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f908824-7abc-41fa-bed7-dafe2c3495c3 req-a3a0d2bb-4a9c-42f8-b921-595d7de4add1 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f908824-7abc-41fa-bed7-dafe2c3495c3 req-a3a0d2bb-4a9c-42f8-b921-595d7de4add1 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:24 user nova-compute[74932]: WARNING nova.compute.manager [req-1f908824-7abc-41fa-bed7-dafe2c3495c3 req-a3a0d2bb-4a9c-42f8-b921-595d7de4add1 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state resized and task_state resize_reverting.
Nov 03 16:30:25 user nova-compute[74932]: INFO nova.compute.manager [None req-01d6d4e8-2b06-420a-9888-7555fe256360 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance to original state: 'active'
Nov 03 16:30:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:26 user nova-compute[74932]: INFO nova.virt.block_device [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Booting with volume 31d04bc8-c7e1-4fd8-933b-c168612bcc51 at /dev/vdb
Nov 03 16:30:26 user nova-compute[74932]: DEBUG os_brick.utils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[859c7eda-1cb6-4af9-b04a-0c22bb60d916]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b1c64f-38bd-4546-8c89-25dab62e83f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760685c-47be-4664-98a0-b4b3647a0740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eddff0-3151-4a61-8103-5d2521826064]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:26 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:30:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93debfd-6520-48eb-8255-efcee2f30f54]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG os_brick.utils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:26 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating existing volume attachment record: 0c2af2bf-fb6a-4982-a2aa-042695267ea4 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:30:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing instance network info cache due to event network-changed-102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] Acquiring lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] Acquired lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.network.neutron [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Refreshing network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:37 user nova-compute[74932]: INFO nova.compute.manager [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Terminating instance
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-df65b960-9032-464b-a151-41f71339d595 req-09ade9c5-a59e-4817-b782-61d1974956f0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-unplugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-df65b960-9032-464b-a151-41f71339d595 req-09ade9c5-a59e-4817-b782-61d1974956f0 service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-df65b960-9032-464b-a151-41f71339d595 req-09ade9c5-a59e-4817-b782-61d1974956f0 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-df65b960-9032-464b-a151-41f71339d595 req-09ade9c5-a59e-4817-b782-61d1974956f0 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-df65b960-9032-464b-a151-41f71339d595 req-09ade9c5-a59e-4817-b782-61d1974956f0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-unplugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-df65b960-9032-464b-a151-41f71339d595 req-09ade9c5-a59e-4817-b782-61d1974956f0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-unplugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.network.neutron [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updated VIF entry in instance network info cache for port 102e231c-e02f-4a02-8534-e22a3c48f0e8. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG nova.network.neutron [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [{"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8c6c9086-4a1e-40ec-9728-fc3751bbcfe0 req-3ccef6bd-9ffa-4b19-823b-7f1a6b46fdcc service nova] Releasing lock "refresh_cache-d8e7e5d7-df88-4470-99f7-24f015dcf32a" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Instance destroyed successfully.
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.objects.instance [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lazy-loading 'resources' on Instance uuid d8e7e5d7-df88-4470-99f7-24f015dcf32a {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-420698720',display_name='tempest-TestShelveInstance-server-420698720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-420698720',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YVp4QArOry6wW4DcYHofoyY7wX7kwbaHbXSXApJtuRayIg7cKh+m1UEUtqjFWuXK9/WyPenbGoccvFYqPtZfuINOvxqUn+6cwjpHHFISvh2O1UB10GIoD8ddRfbp8tQ==',key_name='tempest-TestShelveInstance-110969466',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e73625a0f392447c80d434d24b8218eb',ramdisk_id='',reservation_id='r-tw8lmu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1221651483',owner_user_name='tempest-TestShelveInstance-1221651483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:29:17Z,user_data=None,user_id='dc9effb60d8447f199761e316876ca81',uuid=d8e7e5d7-df88-4470-99f7-24f015dcf32a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converting VIF {"id": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "address": "fa:16:3e:35:1b:03", "network": {"id": "71bd5451-a899-4c70-8413-a9fb61004a2c", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307691441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e73625a0f392447c80d434d24b8218eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102e231c-e0", "ovs_interfaceid": "102e231c-e02f-4a02-8534-e22a3c48f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_vif [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap102e231c-e0, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99f450e0-3346-4bec-bc69-1a8765252d37) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:38 user nova-compute[74932]: INFO os_vif [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1b:03,bridge_name='br-int',has_traffic_filtering=True,id=102e231c-e02f-4a02-8534-e22a3c48f0e8,network=Network(71bd5451-a899-4c70-8413-a9fb61004a2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102e231c-e0')
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVhrZsAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:30:38 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa81cd6-a692-4574-80f4-f255bfa41f6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:30:38 user nova-compute[74932]: No targets found.
Nov 03 16:30:38 user nova-compute[74932]: iSNS:
Nov 03 16:30:38 user nova-compute[74932]: No targets found.
Nov 03 16:30:38 user nova-compute[74932]: STATIC:
Nov 03 16:30:38 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60
Nov 03 16:30:38 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:30:38 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:30:38 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:30:38 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:30:38 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:30:38 user nova-compute[74932]: FIRMWARE:
Nov 03 16:30:38 user nova-compute[74932]: No targets found.
Nov 03 16:30:38 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:30:38 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:30:38 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[805bce58-f661-4821-bcc1-8fcac844b27f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c996b8-401a-4361-a4a3-4ea9a4da2e16]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:30:38 user nova-compute[74932]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:30:38 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 (non-flash)
Nov 03 16:30:38 user nova-compute[74932]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:30:38 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8410cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4743a80-fb02-4ac6-85e7-c13015b3035f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[286b7c31-19ca-4f1b-be6e-5f49ec1b3d17]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0929c11-7c7d-431e-885c-8c8d47b214e9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695147f-ec22-43f5-bd9d-566686936c75]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_271a0be3', '/dev/disk/by-id/scsi-26436623537643865', '/dev/disk/by-id/scsi-1SCST_BIO271a0be3-d6b57d8e03203799') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 16:30:38 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_271a0be3
Nov 03 16:30:38 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26436623537643865
Nov 03 16:30:38 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO271a0be3-d6b57d8e03203799
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8666f953-264a-4037-8fdf-e5cbca68924d]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff50f2d-50a4-49cc-93d1-7e3eb7ccaace]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32db7b5-2782-454f-b304-7fc8f2b3f005]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260]
Nov 03 16:30:38 user nova-compute[74932]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60, portal: 172.16.0.220,3260] successful.
Nov 03 16:30:38 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35980f7b-8727-4640-b188-99ed55d44a60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd0574-7cb3-467e-9f15-13132c994f99]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] <== disconnect_volume: return (419ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:30:38 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Deleting instance files /opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a_del
Nov 03 16:30:38 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Deletion of /opt/stack/data/nova/instances/d8e7e5d7-df88-4470-99f7-24f015dcf32a_del complete
Nov 03 16:30:38 user nova-compute[74932]: INFO nova.compute.manager [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 03 16:30:38 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-4637cabc-5240-40ce-b811-3f3bf8d504f1 req-bec1a028-ff40-4606-833a-a4cf968701d0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-deleted-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:39 user nova-compute[74932]: INFO nova.compute.manager [req-4637cabc-5240-40ce-b811-3f3bf8d504f1 req-bec1a028-ff40-4606-833a-a4cf968701d0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Neutron deleted interface 102e231c-e02f-4a02-8534-e22a3c48f0e8; detaching it from the instance and deleting it from the info cache
Nov 03 16:30:39 user nova-compute[74932]: DEBUG nova.network.neutron [req-4637cabc-5240-40ce-b811-3f3bf8d504f1 req-bec1a028-ff40-4606-833a-a4cf968701d0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:39 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Took 0.60 seconds to deallocate network for instance.
Nov 03 16:30:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-4637cabc-5240-40ce-b811-3f3bf8d504f1 req-bec1a028-ff40-4606-833a-a4cf968701d0 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Detach interface failed, port_id=102e231c-e02f-4a02-8534-e22a3c48f0e8, reason: Instance d8e7e5d7-df88-4470-99f7-24f015dcf32a could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-f691d15d-0792-4f9d-bed3-76de57d92519 req-4b5bf665-a647-41ff-a1cf-9cfb5d40d899 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f691d15d-0792-4f9d-bed3-76de57d92519 req-4b5bf665-a647-41ff-a1cf-9cfb5d40d899 service nova] Acquiring lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f691d15d-0792-4f9d-bed3-76de57d92519 req-4b5bf665-a647-41ff-a1cf-9cfb5d40d899 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f691d15d-0792-4f9d-bed3-76de57d92519 req-4b5bf665-a647-41ff-a1cf-9cfb5d40d899 service nova] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-f691d15d-0792-4f9d-bed3-76de57d92519 req-4b5bf665-a647-41ff-a1cf-9cfb5d40d899 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] No waiting events found dispatching network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:39 user nova-compute[74932]: WARNING nova.compute.manager [req-f691d15d-0792-4f9d-bed3-76de57d92519 req-4b5bf665-a647-41ff-a1cf-9cfb5d40d899 service nova] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Received unexpected event network-vif-plugged-102e231c-e02f-4a02-8534-e22a3c48f0e8 for instance with vm_state active and task_state deleting.
Nov 03 16:30:40 user nova-compute[74932]: INFO nova.compute.manager [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Took 1.07 seconds to detach 1 volumes for instance.
Nov 03 16:30:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] [instance: d8e7e5d7-df88-4470-99f7-24f015dcf32a] Deleting volume: 35980f7b-8727-4640-b188-99ed55d44a60 {{(pid=74932) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 16:30:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.volume.cinder [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Update attachment failed for attachment 2a3f00ba-3578-43bf-8a44-89265eb4537b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-82d96621-e097-4ccd-8d62-27a84722e32a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-82d96621-e097-4ccd-8d62-27a84722e32a)
Nov 03 16:30:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Failed to attach eabd348f-7d4f-4665-8417-d5610b6ff644 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-82d96621-e097-4ccd-8d62-27a84722e32a)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Traceback (most recent call last):
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     self._do_attach(context, instance, volume, volume_api,
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     self._volume_attach(context, volume, connector, instance,
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     connection_info = volume_api.attachment_update(
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     res = method(self, ctx, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     with excutils.save_and_reraise_exception():
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     self.force_reraise()
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     raise self.value
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     return method.func(obj, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     resp = self._update('/attachments/%s' % id, body)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     return self.request(url, method, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee]     raise exceptions.from_response(resp, body)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-82d96621-e097-4ccd-8d62-27a84722e32a)
Nov 03 16:30:40 user nova-compute[74932]: ERROR nova.compute.manager [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] 
Nov 03 16:30:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.179s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server [None req-b5b6cbe5-4db6-4d1f-af48-e705ba6a3b0c tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-82d96621-e097-4ccd-8d62-27a84722e32a)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-82d96621-e097-4ccd-8d62-27a84722e32a)
Nov 03 16:30:40 user nova-compute[74932]: ERROR oslo_messaging.rpc.server 
Nov 03 16:30:41 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:41 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:41 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Deleted allocations for instance d8e7e5d7-df88-4470-99f7-24f015dcf32a
Nov 03 16:30:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9b0a82be-dd13-4169-9bba-41334a8aee24 tempest-TestShelveInstance-1221651483 tempest-TestShelveInstance-1221651483-project-member] Lock "d8e7e5d7-df88-4470-99f7-24f015dcf32a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.040s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Skipping network cache update for instance because it is being deleted. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:42 user nova-compute[74932]: INFO nova.compute.manager [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Terminating instance
Nov 03 16:30:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:43 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Instance destroyed successfully.
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lazy-loading 'resources' on Instance uuid 03f9c482-d1ad-4300-9be3-afc2e0b0bade {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1374950441',display_name='tempest-VolumesAdminNegativeTest-server-1374950441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1374950441',id=4,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbien2zUyTqPgttejhARqEL8/UpoP40PC4629F3+t/DmKF4JuheaabYTHUsHAQW0LdbwHu/tA/m4WkQAFleeqB6Ro7oFInMBCODMaZns2aeJnp5/fvO8zTNiwF8j7L/Tg==',key_name='tempest-keypair-1688586843',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb89089043442b980d4d230bb608ad6',ramdisk_id='',reservation_id='r-j0wpy6z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-164723280',owner_user_name='tempest-VolumesAdminNegativeTest-164723280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f75f8149b74615b3a1e3cf77de2d5e',uuid=03f9c482-d1ad-4300-9be3-afc2e0b0bade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converting VIF {"id": "64a184b0-edac-44db-89ce-63db6e13706b", "address": "fa:16:3e:e2:47:8f", "network": {"id": "37fa8e9e-bf3d-4cb5-ade8-04cda21d2934", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319850702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb89089043442b980d4d230bb608ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a184b0-ed", "ovs_interfaceid": "64a184b0-edac-44db-89ce-63db6e13706b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG os_vif [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64a184b0-ed, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1182fad4-1a01-4a88-8036-dc9f60ec9c06) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:43 user nova-compute[74932]: INFO os_vif [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:47:8f,bridge_name='br-int',has_traffic_filtering=True,id=64a184b0-edac-44db-89ce-63db6e13706b,network=Network(37fa8e9e-bf3d-4cb5-ade8-04cda21d2934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a184b0-ed')
Nov 03 16:30:43 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Deleting instance files /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade_del
Nov 03 16:30:43 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Deletion of /opt/stack/data/nova/instances/03f9c482-d1ad-4300-9be3-afc2e0b0bade_del complete
Nov 03 16:30:43 user nova-compute[74932]: INFO nova.compute.manager [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 16:30:43 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-b3f89da4-c1e8-4e3a-b310-ce3e5f89b49c req-7a64879f-21ee-4bf9-9e7b-79dc6197f818 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-vif-unplugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b3f89da4-c1e8-4e3a-b310-ce3e5f89b49c req-7a64879f-21ee-4bf9-9e7b-79dc6197f818 service nova] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b3f89da4-c1e8-4e3a-b310-ce3e5f89b49c req-7a64879f-21ee-4bf9-9e7b-79dc6197f818 service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b3f89da4-c1e8-4e3a-b310-ce3e5f89b49c req-7a64879f-21ee-4bf9-9e7b-79dc6197f818 service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-b3f89da4-c1e8-4e3a-b310-ce3e5f89b49c req-7a64879f-21ee-4bf9-9e7b-79dc6197f818 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] No waiting events found dispatching network-vif-unplugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-b3f89da4-c1e8-4e3a-b310-ce3e5f89b49c req-7a64879f-21ee-4bf9-9e7b-79dc6197f818 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-vif-unplugged-64a184b0-edac-44db-89ce-63db6e13706b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating instance_info_cache with network_info: [{"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-1b97e423-b373-4f86-8ad7-281b30af23ee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:44 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Took 1.08 seconds to deallocate network for instance.
Nov 03 16:30:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-8225132f-158b-4798-a462-fda4c6a5ec08 req-438882a7-dc0f-4ca8-80d7-8b4ab9240acd service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-vif-deleted-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.392s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:30:45 user nova-compute[74932]: INFO nova.compute.claims [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Claim successful on node user
Nov 03 16:30:45 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Deleted allocations for instance 03f9c482-d1ad-4300-9be3-afc2e0b0bade
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf0dc27-07d0-4a61-a50d-c6f773481ebd tempest-VolumesAdminNegativeTest-164723280 tempest-VolumesAdminNegativeTest-164723280-project-member] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.641s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.network.neutron [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:30:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-eac22972-094e-405f-9c24-3e4e7e386010 req-1ea314f2-e62e-4c13-aaab-aab4305ec1f7 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received event network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eac22972-094e-405f-9c24-3e4e7e386010 req-1ea314f2-e62e-4c13-aaab-aab4305ec1f7 service nova] Acquiring lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eac22972-094e-405f-9c24-3e4e7e386010 req-1ea314f2-e62e-4c13-aaab-aab4305ec1f7 service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eac22972-094e-405f-9c24-3e4e7e386010 req-1ea314f2-e62e-4c13-aaab-aab4305ec1f7 service nova] Lock "03f9c482-d1ad-4300-9be3-afc2e0b0bade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-eac22972-094e-405f-9c24-3e4e7e386010 req-1ea314f2-e62e-4c13-aaab-aab4305ec1f7 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] No waiting events found dispatching network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:45 user nova-compute[74932]: WARNING nova.compute.manager [req-eac22972-094e-405f-9c24-3e4e7e386010 req-1ea314f2-e62e-4c13-aaab-aab4305ec1f7 service nova] [instance: 03f9c482-d1ad-4300-9be3-afc2e0b0bade] Received unexpected event network-vif-plugged-64a184b0-edac-44db-89ce-63db6e13706b for instance with vm_state deleted and task_state None.
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.policy [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd49e83fa0846d191cb4cf0719ba038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b101d0f7f99a41f699e3f2701cc35248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:30:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Creating image(s)
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.229s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk 1073741824" returned: 0 in 0.065s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.216s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG nova.network.neutron [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Successfully created port: d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Cannot resize image /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Ensure instance console log exists: /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG nova.network.neutron [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Successfully updated port: d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquired lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG nova.network.neutron [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-changed-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Refreshing instance network info cache due to event network-changed-d809cace-ae35-4d72-83fb-e0e4a83ea558. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] Acquiring lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Releasing lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance network_info: |[{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] Acquired lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.neutron [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Refreshing network info cache for port d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Start _get_guest_xml network_info=[{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:30:48 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:30:48 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768994889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768994889',id=17,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMg74tpn1Jh2l3/7bwzbGi29wVQa00Lqdj4LoxlzHfDbzcXqn3iwMNhc9A5CxZx3hemUyqu+0fxA7FI9X4Jgw+Z5OuNrS2thzUQ/YToMjxpJ1BNU/iHRky+89bhEdyD5g==',key_name='tempest-keypair-360156465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-oyk2eyi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=358b33c3-c1e4-4f79-a5e0-0b60b9205339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.objects.instance [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'pci_devices' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:30:48 user nova-compute[74932]:   <uuid>358b33c3-c1e4-4f79-a5e0-0b60b9205339</uuid>
Nov 03 16:30:48 user nova-compute[74932]:   <name>instance-00000011</name>
Nov 03 16:30:48 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:30:48 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:30:48 user nova-compute[74932]:   <metadata>
Nov 03 16:30:48 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:30:48 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:30:48 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1768994889</nova:name>
Nov 03 16:30:48 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:30:48</nova:creationTime>
Nov 03 16:30:48 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:30:48 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:30:48 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:30:48 user nova-compute[74932]:       <nova:owner>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:user uuid="6fd49e83fa0846d191cb4cf0719ba038">tempest-AttachVolumeShelveTestJSON-1586732873-project-member</nova:user>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:project uuid="b101d0f7f99a41f699e3f2701cc35248">tempest-AttachVolumeShelveTestJSON-1586732873</nova:project>
Nov 03 16:30:48 user nova-compute[74932]:       </nova:owner>
Nov 03 16:30:48 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:30:48 user nova-compute[74932]:       <nova:ports>
Nov 03 16:30:48 user nova-compute[74932]:         <nova:port uuid="d809cace-ae35-4d72-83fb-e0e4a83ea558">
Nov 03 16:30:48 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 16:30:48 user nova-compute[74932]:         </nova:port>
Nov 03 16:30:48 user nova-compute[74932]:       </nova:ports>
Nov 03 16:30:48 user nova-compute[74932]:     </nova:instance>
Nov 03 16:30:48 user nova-compute[74932]:   </metadata>
Nov 03 16:30:48 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:30:48 user nova-compute[74932]:     <system>
Nov 03 16:30:48 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:30:48 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:30:48 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:30:48 user nova-compute[74932]:       <entry name="serial">358b33c3-c1e4-4f79-a5e0-0b60b9205339</entry>
Nov 03 16:30:48 user nova-compute[74932]:       <entry name="uuid">358b33c3-c1e4-4f79-a5e0-0b60b9205339</entry>
Nov 03 16:30:48 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:30:48 user nova-compute[74932]:     </system>
Nov 03 16:30:48 user nova-compute[74932]:   </sysinfo>
Nov 03 16:30:48 user nova-compute[74932]:   <os>
Nov 03 16:30:48 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:30:48 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:30:48 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:30:48 user nova-compute[74932]:   </os>
Nov 03 16:30:48 user nova-compute[74932]:   <features>
Nov 03 16:30:48 user nova-compute[74932]:     <acpi/>
Nov 03 16:30:48 user nova-compute[74932]:     <apic/>
Nov 03 16:30:48 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:30:48 user nova-compute[74932]:   </features>
Nov 03 16:30:48 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:30:48 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:30:48 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:30:48 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:30:48 user nova-compute[74932]:   </clock>
Nov 03 16:30:48 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:30:48 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:30:48 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:30:48 user nova-compute[74932]:   </cpu>
Nov 03 16:30:48 user nova-compute[74932]:   <devices>
Nov 03 16:30:48 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:30:48 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:30:48 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk"/>
Nov 03 16:30:48 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:30:48 user nova-compute[74932]:     </disk>
Nov 03 16:30:48 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:30:48 user nova-compute[74932]:       <mac address="fa:16:3e:90:ff:74"/>
Nov 03 16:30:48 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:30:48 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:30:48 user nova-compute[74932]:       <target dev="tapd809cace-ae"/>
Nov 03 16:30:48 user nova-compute[74932]:     </interface>
Nov 03 16:30:48 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:30:48 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/console.log" append="off"/>
Nov 03 16:30:48 user nova-compute[74932]:     </serial>
Nov 03 16:30:48 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:30:48 user nova-compute[74932]:     <video>
Nov 03 16:30:48 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:30:48 user nova-compute[74932]:     </video>
Nov 03 16:30:48 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:30:48 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:30:48 user nova-compute[74932]:     </rng>
Nov 03 16:30:48 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:30:48 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:30:48 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:30:48 user nova-compute[74932]:     </memballoon>
Nov 03 16:30:48 user nova-compute[74932]:   </devices>
Nov 03 16:30:48 user nova-compute[74932]: </domain>
Nov 03 16:30:48 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768994889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768994889',id=17,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMg74tpn1Jh2l3/7bwzbGi29wVQa00Lqdj4LoxlzHfDbzcXqn3iwMNhc9A5CxZx3hemUyqu+0fxA7FI9X4Jgw+Z5OuNrS2thzUQ/YToMjxpJ1BNU/iHRky+89bhEdyD5g==',key_name='tempest-keypair-360156465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-oyk2eyi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=358b33c3-c1e4-4f79-a5e0-0b60b9205339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG os_vif [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dd31c87-c995-587b-8cf6-3e921c497bdb', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd809cace-ae, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd809cace-ae, col_values=(('qos', UUID('d0cc75d6-d1de-4a80-921b-e58684318f20')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd809cace-ae, col_values=(('external_ids', {'iface-id': 'd809cace-ae35-4d72-83fb-e0e4a83ea558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ff:74', 'vm-uuid': '358b33c3-c1e4-4f79-a5e0-0b60b9205339'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:48 user nova-compute[74932]: INFO os_vif [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae')
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No VIF found with MAC fa:16:3e:90:ff:74, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:30:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG nova.network.neutron [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updated VIF entry in instance network info cache for port d809cace-ae35-4d72-83fb-e0e4a83ea558. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG nova.network.neutron [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3e908552-a3ee-4e23-8efc-f7b4dff0d49f req-f199833e-932c-4632-8b86-2d9994a9b880 service nova] Releasing lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-e42a9561-6a90-49c9-9d53-053caa448a88 req-f0f7923f-b93c-43a3-ac55-849f749e191c service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e42a9561-6a90-49c9-9d53-053caa448a88 req-f0f7923f-b93c-43a3-ac55-849f749e191c service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e42a9561-6a90-49c9-9d53-053caa448a88 req-f0f7923f-b93c-43a3-ac55-849f749e191c service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e42a9561-6a90-49c9-9d53-053caa448a88 req-f0f7923f-b93c-43a3-ac55-849f749e191c service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-e42a9561-6a90-49c9-9d53-053caa448a88 req-f0f7923f-b93c-43a3-ac55-849f749e191c service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:50 user nova-compute[74932]: WARNING nova.compute.manager [req-e42a9561-6a90-49c9-9d53-053caa448a88 req-f0f7923f-b93c-43a3-ac55-849f749e191c service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state building and task_state spawning.
Nov 03 16:30:50 user nova-compute[74932]: INFO nova.virt.block_device [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Booting with volume 918b72de-ad14-4686-9ba2-0ef5387cca62 at /dev/vdc
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG os_brick.utils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c41c07-7e1f-4944-8e31-679ed2af4b6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b20d329-6b59-4db4-978f-b8fb3b15271e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4500e999-7de6-407e-8466-ad60990f01e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed28d46-46a8-44dc-a5a3-32d0ff16f471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:30:50 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26b64d8-32f2-4eeb-a4a2-73e7d2d5d356]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG os_brick.utils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating existing volume attachment record: 4708d4ac-480c-4a92-81e3-b69ec0af14d6 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-ffd7f10e-b2c1-4f1c-9a0f-f7cb4f67a25d req-66dfdb9c-bdde-4090-931b-b9e13c56c01b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ffd7f10e-b2c1-4f1c-9a0f-f7cb4f67a25d req-66dfdb9c-bdde-4090-931b-b9e13c56c01b service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ffd7f10e-b2c1-4f1c-9a0f-f7cb4f67a25d req-66dfdb9c-bdde-4090-931b-b9e13c56c01b service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ffd7f10e-b2c1-4f1c-9a0f-f7cb4f67a25d req-66dfdb9c-bdde-4090-931b-b9e13c56c01b service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-ffd7f10e-b2c1-4f1c-9a0f-f7cb4f67a25d req-66dfdb9c-bdde-4090-931b-b9e13c56c01b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:30:52 user nova-compute[74932]: WARNING nova.compute.manager [req-ffd7f10e-b2c1-4f1c-9a0f-f7cb4f67a25d req-66dfdb9c-bdde-4090-931b-b9e13c56c01b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state building and task_state spawning.
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:30:52 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:30:52 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=25.551158905029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:52 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance spawned successfully.
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:30:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1b97e423-b373-4f86-8ad7-281b30af23ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 358b33c3-c1e4-4f79-a5e0-0b60b9205339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:30:53 user nova-compute[74932]: INFO nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Took 7.19 seconds to spawn the instance on the hypervisor.
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:53 user nova-compute[74932]: INFO nova.compute.manager [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Took 8.48 seconds to build instance.
Nov 03 16:30:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-abc4b84a-6176-4929-887d-f168d9f9f482 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.608s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:30:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "1ed9acd4-1794-429c-9c37-84a58024947c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:30:57 user nova-compute[74932]: INFO nova.compute.claims [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Claim successful on node user
Nov 03 16:30:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:30:57 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.policy [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '462c0b16a5f744e49b3ee3ef8ee39e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1f1557f72d4ca1ac1d34772c23a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:30:57 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Creating image(s)
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:30:58 user nova-compute[74932]: INFO nova.compute.claims [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Claim successful on node user
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.237s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk 1073741824" returned: 0 in 0.331s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.523s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Successfully created port: 383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.838s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.224s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:30:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:30:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Cannot resize image /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Ensure instance console log exists: /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.policy [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '462c0b16a5f744e49b3ee3ef8ee39e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1f1557f72d4ca1ac1d34772c23a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:30:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Creating image(s)
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.231s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Successfully updated port: 383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-changed-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Refreshing instance network info cache due to event network-changed-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk 1073741824" returned: 0 in 0.074s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:30:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Successfully created port: 6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.226s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance network_info: |[{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Refreshing network info cache for port 383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Start _get_guest_xml network_info=[{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:31:00 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:00 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2063351239',display_name='tempest-ServerRescueNegativeTestJSON-server-2063351239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2063351239',id=18,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-39nqenhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:58Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=1ed9acd4-1794-429c-9c37-84a58024947c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.objects.instance [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Cannot resize image /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Ensure instance console log exists: /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:31:00 user nova-compute[74932]:   <uuid>1ed9acd4-1794-429c-9c37-84a58024947c</uuid>
Nov 03 16:31:00 user nova-compute[74932]:   <name>instance-00000012</name>
Nov 03 16:31:00 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:31:00 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:31:00 user nova-compute[74932]:   <metadata>
Nov 03 16:31:00 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:31:00 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:31:00 user nova-compute[74932]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2063351239</nova:name>
Nov 03 16:31:00 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:31:00</nova:creationTime>
Nov 03 16:31:00 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:31:00 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:31:00 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:31:00 user nova-compute[74932]:       <nova:owner>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:user uuid="462c0b16a5f744e49b3ee3ef8ee39e00">tempest-ServerRescueNegativeTestJSON-1518505179-project-member</nova:user>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:project uuid="dd1f1557f72d4ca1ac1d34772c23a953">tempest-ServerRescueNegativeTestJSON-1518505179</nova:project>
Nov 03 16:31:00 user nova-compute[74932]:       </nova:owner>
Nov 03 16:31:00 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:31:00 user nova-compute[74932]:       <nova:ports>
Nov 03 16:31:00 user nova-compute[74932]:         <nova:port uuid="383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c">
Nov 03 16:31:00 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:31:00 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:00 user nova-compute[74932]:       </nova:ports>
Nov 03 16:31:00 user nova-compute[74932]:     </nova:instance>
Nov 03 16:31:00 user nova-compute[74932]:   </metadata>
Nov 03 16:31:00 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:31:00 user nova-compute[74932]:     <system>
Nov 03 16:31:00 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:31:00 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:31:00 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:31:00 user nova-compute[74932]:       <entry name="serial">1ed9acd4-1794-429c-9c37-84a58024947c</entry>
Nov 03 16:31:00 user nova-compute[74932]:       <entry name="uuid">1ed9acd4-1794-429c-9c37-84a58024947c</entry>
Nov 03 16:31:00 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:31:00 user nova-compute[74932]:     </system>
Nov 03 16:31:00 user nova-compute[74932]:   </sysinfo>
Nov 03 16:31:00 user nova-compute[74932]:   <os>
Nov 03 16:31:00 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:31:00 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:31:00 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:31:00 user nova-compute[74932]:   </os>
Nov 03 16:31:00 user nova-compute[74932]:   <features>
Nov 03 16:31:00 user nova-compute[74932]:     <acpi/>
Nov 03 16:31:00 user nova-compute[74932]:     <apic/>
Nov 03 16:31:00 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:31:00 user nova-compute[74932]:   </features>
Nov 03 16:31:00 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:31:00 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:31:00 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:31:00 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:31:00 user nova-compute[74932]:   </clock>
Nov 03 16:31:00 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:31:00 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:31:00 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:31:00 user nova-compute[74932]:   </cpu>
Nov 03 16:31:00 user nova-compute[74932]:   <devices>
Nov 03 16:31:00 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:31:00 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:31:00 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk"/>
Nov 03 16:31:00 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:31:00 user nova-compute[74932]:     </disk>
Nov 03 16:31:00 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:00 user nova-compute[74932]:       <mac address="fa:16:3e:28:95:4e"/>
Nov 03 16:31:00 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:00 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:00 user nova-compute[74932]:       <target dev="tap383bb4bc-f4"/>
Nov 03 16:31:00 user nova-compute[74932]:     </interface>
Nov 03 16:31:00 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:31:00 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/console.log" append="off"/>
Nov 03 16:31:00 user nova-compute[74932]:     </serial>
Nov 03 16:31:00 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:31:00 user nova-compute[74932]:     <video>
Nov 03 16:31:00 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:00 user nova-compute[74932]:     </video>
Nov 03 16:31:00 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:31:00 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:31:00 user nova-compute[74932]:     </rng>
Nov 03 16:31:00 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:31:00 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:31:00 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:31:00 user nova-compute[74932]:     </memballoon>
Nov 03 16:31:00 user nova-compute[74932]:   </devices>
Nov 03 16:31:00 user nova-compute[74932]: </domain>
Nov 03 16:31:00 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2063351239',display_name='tempest-ServerRescueNegativeTestJSON-server-2063351239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2063351239',id=18,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-39nqenhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:58Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=1ed9acd4-1794-429c-9c37-84a58024947c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG os_vif [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '144787ad-52d2-59c4-9fc1-579ec78be38d', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap383bb4bc-f4, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap383bb4bc-f4, col_values=(('qos', UUID('540b5a91-e7f3-45b6-ad41-b3bcb505c2d4')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap383bb4bc-f4, col_values=(('external_ids', {'iface-id': '383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:95:4e', 'vm-uuid': '1ed9acd4-1794-429c-9c37-84a58024947c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:00 user nova-compute[74932]: INFO os_vif [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4')
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:28:95:4e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updated VIF entry in instance network info cache for port 383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Successfully updated port: 6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8f4e0b62-b832-4f3b-8f72-24be846ab990 req-27d2357f-b659-4471-bc23-f051de5487e4 service nova] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-changed-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Refreshing instance network info cache due to event network-changed-6e55e6c0-b9a2-46a5-864b-fad6269714ea. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] Acquiring lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance network_info: |[{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] Acquired lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Refreshing network info cache for port 6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Start _get_guest_xml network_info=[{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:31:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-989134293',display_name='tempest-ServerRescueNegativeTestJSON-server-989134293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-989134293',id=19,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-lji0h7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:59Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=16bb1633-adf9-4889-a809-3e4eac1071b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'pci_devices' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:31:01 user nova-compute[74932]:   <uuid>16bb1633-adf9-4889-a809-3e4eac1071b9</uuid>
Nov 03 16:31:01 user nova-compute[74932]:   <name>instance-00000013</name>
Nov 03 16:31:01 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:31:01 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:31:01 user nova-compute[74932]:   <metadata>
Nov 03 16:31:01 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:31:01 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:31:01 user nova-compute[74932]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-989134293</nova:name>
Nov 03 16:31:01 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:31:01</nova:creationTime>
Nov 03 16:31:01 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:31:01 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:31:01 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:31:01 user nova-compute[74932]:       <nova:owner>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:user uuid="462c0b16a5f744e49b3ee3ef8ee39e00">tempest-ServerRescueNegativeTestJSON-1518505179-project-member</nova:user>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:project uuid="dd1f1557f72d4ca1ac1d34772c23a953">tempest-ServerRescueNegativeTestJSON-1518505179</nova:project>
Nov 03 16:31:01 user nova-compute[74932]:       </nova:owner>
Nov 03 16:31:01 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:31:01 user nova-compute[74932]:       <nova:ports>
Nov 03 16:31:01 user nova-compute[74932]:         <nova:port uuid="6e55e6c0-b9a2-46a5-864b-fad6269714ea">
Nov 03 16:31:01 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:31:01 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:01 user nova-compute[74932]:       </nova:ports>
Nov 03 16:31:01 user nova-compute[74932]:     </nova:instance>
Nov 03 16:31:01 user nova-compute[74932]:   </metadata>
Nov 03 16:31:01 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:31:01 user nova-compute[74932]:     <system>
Nov 03 16:31:01 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:31:01 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:31:01 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:31:01 user nova-compute[74932]:       <entry name="serial">16bb1633-adf9-4889-a809-3e4eac1071b9</entry>
Nov 03 16:31:01 user nova-compute[74932]:       <entry name="uuid">16bb1633-adf9-4889-a809-3e4eac1071b9</entry>
Nov 03 16:31:01 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:31:01 user nova-compute[74932]:     </system>
Nov 03 16:31:01 user nova-compute[74932]:   </sysinfo>
Nov 03 16:31:01 user nova-compute[74932]:   <os>
Nov 03 16:31:01 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:31:01 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:31:01 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:31:01 user nova-compute[74932]:   </os>
Nov 03 16:31:01 user nova-compute[74932]:   <features>
Nov 03 16:31:01 user nova-compute[74932]:     <acpi/>
Nov 03 16:31:01 user nova-compute[74932]:     <apic/>
Nov 03 16:31:01 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:31:01 user nova-compute[74932]:   </features>
Nov 03 16:31:01 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:31:01 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:31:01 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:31:01 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:31:01 user nova-compute[74932]:   </clock>
Nov 03 16:31:01 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:31:01 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:31:01 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:31:01 user nova-compute[74932]:   </cpu>
Nov 03 16:31:01 user nova-compute[74932]:   <devices>
Nov 03 16:31:01 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:31:01 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:31:01 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk"/>
Nov 03 16:31:01 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:31:01 user nova-compute[74932]:     </disk>
Nov 03 16:31:01 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:01 user nova-compute[74932]:       <mac address="fa:16:3e:23:89:6c"/>
Nov 03 16:31:01 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:01 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:01 user nova-compute[74932]:       <target dev="tap6e55e6c0-b9"/>
Nov 03 16:31:01 user nova-compute[74932]:     </interface>
Nov 03 16:31:01 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:31:01 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/console.log" append="off"/>
Nov 03 16:31:01 user nova-compute[74932]:     </serial>
Nov 03 16:31:01 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:31:01 user nova-compute[74932]:     <video>
Nov 03 16:31:01 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:01 user nova-compute[74932]:     </video>
Nov 03 16:31:01 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:31:01 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:31:01 user nova-compute[74932]:     </rng>
Nov 03 16:31:01 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:31:01 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:31:01 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:31:01 user nova-compute[74932]:     </memballoon>
Nov 03 16:31:01 user nova-compute[74932]:   </devices>
Nov 03 16:31:01 user nova-compute[74932]: </domain>
Nov 03 16:31:01 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-989134293',display_name='tempest-ServerRescueNegativeTestJSON-server-989134293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-989134293',id=19,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-lji0h7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:59Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=16bb1633-adf9-4889-a809-3e4eac1071b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG os_vif [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb0f3468-5224-5c65-ae28-418241625f63', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e55e6c0-b9, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e55e6c0-b9, col_values=(('qos', UUID('f859ef47-01fc-4569-9baa-5022533703ea')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e55e6c0-b9, col_values=(('external_ids', {'iface-id': '6e55e6c0-b9a2-46a5-864b-fad6269714ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:89:6c', 'vm-uuid': '16bb1633-adf9-4889-a809-3e4eac1071b9'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:01 user nova-compute[74932]: INFO os_vif [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9')
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:23:89:6c, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updated VIF entry in instance network info cache for port 6e55e6c0-b9a2-46a5-864b-fad6269714ea. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d1667837-c7f8-4d15-9586-685a612d718f req-45bf8ad2-cd2c-405a-8e8b-65390014fdd5 service nova] Releasing lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG nova.compute.manager [req-e8db3d2d-4c3d-4bc3-942d-c7cb34d37893 req-666a9cac-5079-4505-be4a-6325f352ba9d service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e8db3d2d-4c3d-4bc3-942d-c7cb34d37893 req-666a9cac-5079-4505-be4a-6325f352ba9d service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e8db3d2d-4c3d-4bc3-942d-c7cb34d37893 req-666a9cac-5079-4505-be4a-6325f352ba9d service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e8db3d2d-4c3d-4bc3-942d-c7cb34d37893 req-666a9cac-5079-4505-be4a-6325f352ba9d service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG nova.compute.manager [req-e8db3d2d-4c3d-4bc3-942d-c7cb34d37893 req-666a9cac-5079-4505-be4a-6325f352ba9d service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:02 user nova-compute[74932]: WARNING nova.compute.manager [req-e8db3d2d-4c3d-4bc3-942d-c7cb34d37893 req-666a9cac-5079-4505-be4a-6325f352ba9d service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state building and task_state spawning.
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-b8a71d4d-35d3-433c-b8a7-e49a798b11db req-a47a0c81-20c7-4d81-a0fe-7336e130e104 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b8a71d4d-35d3-433c-b8a7-e49a798b11db req-a47a0c81-20c7-4d81-a0fe-7336e130e104 service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b8a71d4d-35d3-433c-b8a7-e49a798b11db req-a47a0c81-20c7-4d81-a0fe-7336e130e104 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b8a71d4d-35d3-433c-b8a7-e49a798b11db req-a47a0c81-20c7-4d81-a0fe-7336e130e104 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-b8a71d4d-35d3-433c-b8a7-e49a798b11db req-a47a0c81-20c7-4d81-a0fe-7336e130e104 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:03 user nova-compute[74932]: WARNING nova.compute.manager [req-b8a71d4d-35d3-433c-b8a7-e49a798b11db req-a47a0c81-20c7-4d81-a0fe-7336e130e104 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state building and task_state spawning.
Nov 03 16:31:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-aa562c4f-26e2-4d35-ba51-6bd983b41e55 req-ab4d8a85-ecb8-4b5d-95b5-6f1253ad0528 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-aa562c4f-26e2-4d35-ba51-6bd983b41e55 req-ab4d8a85-ecb8-4b5d-95b5-6f1253ad0528 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-aa562c4f-26e2-4d35-ba51-6bd983b41e55 req-ab4d8a85-ecb8-4b5d-95b5-6f1253ad0528 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-aa562c4f-26e2-4d35-ba51-6bd983b41e55 req-ab4d8a85-ecb8-4b5d-95b5-6f1253ad0528 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-aa562c4f-26e2-4d35-ba51-6bd983b41e55 req-ab4d8a85-ecb8-4b5d-95b5-6f1253ad0528 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:04 user nova-compute[74932]: WARNING nova.compute.manager [req-aa562c4f-26e2-4d35-ba51-6bd983b41e55 req-ab4d8a85-ecb8-4b5d-95b5-6f1253ad0528 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state building and task_state spawning.
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:31:05 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance spawned successfully.
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-465301a5-5966-460f-a543-6834e674606e req-e6c8df80-15fc-4cc1-9457-db0d7cc98d04 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-465301a5-5966-460f-a543-6834e674606e req-e6c8df80-15fc-4cc1-9457-db0d7cc98d04 service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-465301a5-5966-460f-a543-6834e674606e req-e6c8df80-15fc-4cc1-9457-db0d7cc98d04 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-465301a5-5966-460f-a543-6834e674606e req-e6c8df80-15fc-4cc1-9457-db0d7cc98d04 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-465301a5-5966-460f-a543-6834e674606e req-e6c8df80-15fc-4cc1-9457-db0d7cc98d04 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:05 user nova-compute[74932]: WARNING nova.compute.manager [req-465301a5-5966-460f-a543-6834e674606e req-e6c8df80-15fc-4cc1-9457-db0d7cc98d04 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state building and task_state spawning.
Nov 03 16:31:05 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance spawned successfully.
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:06 user nova-compute[74932]: INFO nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 03 16:31:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:31:06 user nova-compute[74932]: INFO nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Took 8.06 seconds to spawn the instance on the hypervisor.
Nov 03 16:31:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:31:06 user nova-compute[74932]: INFO nova.compute.manager [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Took 8.09 seconds to build instance.
Nov 03 16:31:06 user nova-compute[74932]: INFO nova.compute.manager [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Took 8.93 seconds to build instance.
Nov 03 16:31:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d4efc504-d528-4296-acca-946ed1322e0a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.221s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a4c3459-78ce-4c2c-9544-e844f409d9e5 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "1ed9acd4-1794-429c-9c37-84a58024947c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.036s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:31:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Creating image(s)
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Ensure instance console log exists: /opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Start _get_guest_xml network_info=[{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yziKXCoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4a8c616-f7d5-47a1-950e-f14740a88f88', 'serial': 'f4a8c616-f7d5-47a1-950e-f14740a88f88'}, 'attachment_id': '872c4d6f-8de6-447e-a6e9-b5e4d63462ae', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVpMwqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c', 'attached_at': '', 'detached_at': '', 'volume_id': '31d04bc8-c7e1-4fd8-933b-c168612bcc51', 'serial': '31d04bc8-c7e1-4fd8-933b-c168612bcc51'}, 'attachment_id': '0c2af2bf-fb6a-4982-a2aa-042695267ea4', 'boot_index': 1, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeJaAbON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c', 'attached_at': '', 'detached_at': '', 'volume_id': '918b72de-ad14-4686-9ba2-0ef5387cca62', 'serial': '918b72de-ad14-4686-9ba2-0ef5387cca62'}, 'attachment_id': '4708d4ac-480c-4a92-81e3-b69ec0af14d6', 'boot_index': 2, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:31:14 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:14 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yziKXCoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:31:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:31:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:31:14 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e23601-cf88-4f18-bf83-9662b47a9d25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:31:14 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a50e26-d97e-4363-889a-bbf0c779ec4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88] added
Nov 03 16:31:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5fe9b4-a1d6-4351-b5e6-adb867ccb0a3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a7c5e-ee48-4629-99f0-8d5deaf19614]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yziKXCoq {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yziKXCoq" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad25c5e-da07-47a5-a9ca-83a249a1e2d3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yziKXCoq'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab5945-4161-468d-8871-7862bd6a6c8e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b3eb64-6356-4d18-8e47-f4e329213cd4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e53e8c-9b14-46fc-9f14-6fede6687470]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260]
Nov 03 16:31:14 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260] successful.
Nov 03 16:31:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b67517-3fc4-4764-9649-4acd01c4a06e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfe7fff-430e-4e92-bfad-618e7f6cc8ad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:14 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:14 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cdc6d9-599c-4cf0-89f9-c2b5c1cb8b30]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:31:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yziKXCoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23039616466353166', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039616466353166', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVpMwqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:31:15 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:31:15 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:31:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:31:15 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:31:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b0a063-af0f-4480-92ca-4eccca2d6dea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:31:16 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636606c-5bc9-4761-b962-9cf8a616aeea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51] added
Nov 03 16:31:16 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a422ac-90b0-4b8d-8052-32aab43ede2b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f8c42-0c66-4d65-ba57-b40244c3920c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVpMwqIg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVpMwqIg" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8bdbd0-8bb0-4cce-a706-d9ffe18d66f2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVpMwqIg'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ced7a1-ff2d-4598-9dae-c105dafe7f94]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5682d61d-306e-4ad8-a48e-a41620fdcaab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:16 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:16 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:16 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:16 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b778c4b-dd40-4588-889a-a655bd4e5589]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260]
Nov 03 16:31:16 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260] successful.
Nov 03 16:31:16 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195f4b6-a50a-48c1-b74d-c429fbb7e426]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312dd7a-1554-4bd1-93b0-7e139dca2f7f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:16 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:16 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:31:16 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:16 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:16 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:31:16 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd50614b-f027-41fd-96e8-1efc892d3ff4]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:31:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVpMwqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23032393238346439', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032393238346439', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeJaAbON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:31:17 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:31:17 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:31:17 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[458a0100-7823-42bd-9d4b-5dae40bda18f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:31:17 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d5813-7626-4a2f-98bd-9568ed609553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62] added
Nov 03 16:31:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1724fc73-4d48-4c3f-bb59-b324eb5cf8b5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ba16a8-b5d2-444a-8249-0be61ef07fb8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeJaAbON {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeJaAbON" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d5204-bc6b-422a-ad7b-4535d1b1f457]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeJaAbON'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee1783f-b625-41f8-96b1-e9e33334f351]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6455be6-ae45-40ba-9ba1-8ac56d99ca00]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[adddc16c-851f-496f-97c8-02e40476b542]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260]
Nov 03 16:31:17 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260] successful.
Nov 03 16:31:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf839e-8e08-4852-b63e-4b43ec9b5a6c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1044c9-eb1d-476b-8fd5-dacaf777899b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:31:17 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3a55ac-10a3-4d04-bf91-b744990dafd1]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:31:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeJaAbON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23230636234316163', 'path': '/dev/sde'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230636234316163', 'path': '/dev/sde'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lazy-loading 'pci_devices' on Instance uuid f8c9cca7-1c97-4af8-9c7d-c823330e507c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:31:18 user nova-compute[74932]:   <uuid>f8c9cca7-1c97-4af8-9c7d-c823330e507c</uuid>
Nov 03 16:31:18 user nova-compute[74932]:   <name>instance-00000010</name>
Nov 03 16:31:18 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:31:18 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:31:18 user nova-compute[74932]:   <metadata>
Nov 03 16:31:18 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:31:18 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:31:18 user nova-compute[74932]:       <nova:name>tempest-device-tagging-server-1838768569</nova:name>
Nov 03 16:31:18 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:31:14</nova:creationTime>
Nov 03 16:31:18 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:31:18 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:31:18 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:31:18 user nova-compute[74932]:       <nova:owner>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:user uuid="64e88e0fca994117a979a0e664b01b38">tempest-TaggedBootDevicesTest_v242-2142622839-project-member</nova:user>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:project uuid="846c49ad0b704a60b8bc3b11cdaace79">tempest-TaggedBootDevicesTest_v242-2142622839</nova:project>
Nov 03 16:31:18 user nova-compute[74932]:       </nova:owner>
Nov 03 16:31:18 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:31:18 user nova-compute[74932]:       <nova:ports>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="1abb133f-d6e7-4993-a37b-abe7343e75b0">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="4afaedc9-d29c-4d64-8bfe-96b70b3ec81f">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="d4c7edf5-b485-4434-a7c3-4740df831df8">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="b806163e-05c2-4c65-b7c6-9bd524d51962">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="4f833233-310c-4d46-90f5-24b22a340ba6">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="da2d68a2-4bfd-494f-a06f-815126402456">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:         <nova:port uuid="01e0d16c-3622-40ef-9fca-d86a087d7796">
Nov 03 16:31:18 user nova-compute[74932]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 16:31:18 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:18 user nova-compute[74932]:       </nova:ports>
Nov 03 16:31:18 user nova-compute[74932]:     </nova:instance>
Nov 03 16:31:18 user nova-compute[74932]:   </metadata>
Nov 03 16:31:18 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:31:18 user nova-compute[74932]:     <system>
Nov 03 16:31:18 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:31:18 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:31:18 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:31:18 user nova-compute[74932]:       <entry name="serial">f8c9cca7-1c97-4af8-9c7d-c823330e507c</entry>
Nov 03 16:31:18 user nova-compute[74932]:       <entry name="uuid">f8c9cca7-1c97-4af8-9c7d-c823330e507c</entry>
Nov 03 16:31:18 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:31:18 user nova-compute[74932]:     </system>
Nov 03 16:31:18 user nova-compute[74932]:   </sysinfo>
Nov 03 16:31:18 user nova-compute[74932]:   <os>
Nov 03 16:31:18 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:31:18 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:31:18 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:31:18 user nova-compute[74932]:   </os>
Nov 03 16:31:18 user nova-compute[74932]:   <features>
Nov 03 16:31:18 user nova-compute[74932]:     <acpi/>
Nov 03 16:31:18 user nova-compute[74932]:     <apic/>
Nov 03 16:31:18 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:31:18 user nova-compute[74932]:   </features>
Nov 03 16:31:18 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:31:18 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:31:18 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:31:18 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:31:18 user nova-compute[74932]:   </clock>
Nov 03 16:31:18 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:31:18 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:31:18 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:31:18 user nova-compute[74932]:   </cpu>
Nov 03 16:31:18 user nova-compute[74932]:   <devices>
Nov 03 16:31:18 user nova-compute[74932]:     <disk type="file" device="cdrom">
Nov 03 16:31:18 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 16:31:18 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c/disk.config"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="hda" bus="ide"/>
Nov 03 16:31:18 user nova-compute[74932]:     </disk>
Nov 03 16:31:18 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:31:18 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:31:18 user nova-compute[74932]:       <source dev="/dev/sdb"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <serial>f4a8c616-f7d5-47a1-950e-f14740a88f88</serial>
Nov 03 16:31:18 user nova-compute[74932]:     </disk>
Nov 03 16:31:18 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:31:18 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:31:18 user nova-compute[74932]:       <source dev="/dev/sdd"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <serial>31d04bc8-c7e1-4fd8-933b-c168612bcc51</serial>
Nov 03 16:31:18 user nova-compute[74932]:     </disk>
Nov 03 16:31:18 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:31:18 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:31:18 user nova-compute[74932]:       <source dev="/dev/sde"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="vdc" bus="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <serial>918b72de-ad14-4686-9ba2-0ef5387cca62</serial>
Nov 03 16:31:18 user nova-compute[74932]:     </disk>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:6e:1a:c4"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tap1abb133f-d6"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:75:e7:18"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tap4afaedc9-d2"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:5b:27:83"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tapd4c7edf5-b4"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:74:48:40"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tapb806163e-05"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:27:98:1e"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tap4f833233-31"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:ee:43:24"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tapda2d68a2-4b"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:18 user nova-compute[74932]:       <mac address="fa:16:3e:e9:e0:41"/>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:18 user nova-compute[74932]:       <target dev="tap01e0d16c-36"/>
Nov 03 16:31:18 user nova-compute[74932]:     </interface>
Nov 03 16:31:18 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:31:18 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c/console.log" append="off"/>
Nov 03 16:31:18 user nova-compute[74932]:     </serial>
Nov 03 16:31:18 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:31:18 user nova-compute[74932]:     <video>
Nov 03 16:31:18 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:18 user nova-compute[74932]:     </video>
Nov 03 16:31:18 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:31:18 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:31:18 user nova-compute[74932]:     </rng>
Nov 03 16:31:18 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:31:18 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:31:18 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:31:18 user nova-compute[74932]:     </memballoon>
Nov 03 16:31:18 user nova-compute[74932]:   </devices>
Nov 03 16:31:18 user nova-compute[74932]: </domain>
Nov 03 16:31:18 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91754011-602a-5f11-8568-cd70430e287e', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1abb133f-d6, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1abb133f-d6, col_values=(('qos', UUID('58251878-02bb-493e-88ae-254f494e65e7')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1abb133f-d6, col_values=(('external_ids', {'iface-id': '1abb133f-d6e7-4993-a37b-abe7343e75b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1a:c4', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6')
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e527d69-813b-5956-8ff8-f33451c71594', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4afaedc9-d2, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4afaedc9-d2, col_values=(('qos', UUID('0752c34d-c483-4565-bee9-c948a45d358b')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4afaedc9-d2, col_values=(('external_ids', {'iface-id': '4afaedc9-d29c-4d64-8bfe-96b70b3ec81f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:e7:18', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2')
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09776ad3-23d3-5ed0-becc-4ffa0ff9adb9', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4c7edf5-b4, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4c7edf5-b4, col_values=(('qos', UUID('b4dcb54c-8752-4a12-bc46-0d3d72fef083')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4c7edf5-b4, col_values=(('external_ids', {'iface-id': 'd4c7edf5-b485-4434-a7c3-4740df831df8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:27:83', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4')
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9942446f-1218-57c8-8b7a-87df528e7363', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb806163e-05, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb806163e-05, col_values=(('qos', UUID('6b9fa26c-65db-43e6-8c00-541c9c1654f0')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb806163e-05, col_values=(('external_ids', {'iface-id': 'b806163e-05c2-4c65-b7c6-9bd524d51962', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:48:40', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05')
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '833c3f8a-14cd-59ef-935f-4f47757032c6', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f833233-31, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f833233-31, col_values=(('qos', UUID('42a4ca40-8b52-424c-bac7-9ccd4d8012ef')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f833233-31, col_values=(('external_ids', {'iface-id': '4f833233-310c-4d46-90f5-24b22a340ba6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:98:1e', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31')
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41af67c3-f2f5-57c7-90b0-802a6b2d78fb', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda2d68a2-4b, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda2d68a2-4b, col_values=(('qos', UUID('bef766fa-a74f-4218-bf16-c2f3a4fea316')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda2d68a2-4b, col_values=(('external_ids', {'iface-id': 'da2d68a2-4bfd-494f-a06f-815126402456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:43:24', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b')
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8894b86-b623-5390-87df-978db4001f59', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01e0d16c-36, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01e0d16c-36, col_values=(('qos', UUID('f5538fa1-2c9d-42e4-860a-75614eebd004')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01e0d16c-36, col_values=(('external_ids', {'iface-id': '01e0d16c-3622-40ef-9fca-d86a087d7796', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:e0:41', 'vm-uuid': 'f8c9cca7-1c97-4af8-9c7d-c823330e507c'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:19 user nova-compute[74932]: INFO os_vif [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36')
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] No BDM found with device name hda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] No VIF found with MAC fa:16:3e:6e:1a:c4, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:31:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] No VIF found with MAC fa:16:3e:27:98:1e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:31:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Using config drive
Nov 03 16:31:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Creating config drive at /opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c/disk.config
Nov 03 16:31:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuhofrvrs {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuhofrvrs" returned: 0 in 0.278s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:20 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:31:20 user nova-compute[74932]: INFO nova.compute.claims [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Claim successful on node user
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.network.neutron [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:31:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.policy [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90fa01b533204995b57b88b0a4aac138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8cbb942aff476ebf7cca3968447573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:31:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Creating image(s)
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "/opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "/opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.244s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk 1073741824" returned: 0 in 0.070s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Successfully created port: 0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-d3761468-87b4-470c-94e3-2c06cb27c359 req-a692eef7-e1bb-49cc-90aa-0995e4d15ff7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d3761468-87b4-470c-94e3-2c06cb27c359 req-a692eef7-e1bb-49cc-90aa-0995e4d15ff7 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d3761468-87b4-470c-94e3-2c06cb27c359 req-a692eef7-e1bb-49cc-90aa-0995e4d15ff7 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d3761468-87b4-470c-94e3-2c06cb27c359 req-a692eef7-e1bb-49cc-90aa-0995e4d15ff7 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-d3761468-87b4-470c-94e3-2c06cb27c359 req-a692eef7-e1bb-49cc-90aa-0995e4d15ff7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:22 user nova-compute[74932]: WARNING nova.compute.manager [req-d3761468-87b4-470c-94e3-2c06cb27c359 req-a692eef7-e1bb-49cc-90aa-0995e4d15ff7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 for instance with vm_state building and task_state spawning.
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.241s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Cannot resize image /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Ensure instance console log exists: /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-9d23c3ba-208a-45bb-bda3-24dca42f8a4b req-81c79b74-a54f-40d7-8f97-3e79efcc4192 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9d23c3ba-208a-45bb-bda3-24dca42f8a4b req-81c79b74-a54f-40d7-8f97-3e79efcc4192 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9d23c3ba-208a-45bb-bda3-24dca42f8a4b req-81c79b74-a54f-40d7-8f97-3e79efcc4192 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9d23c3ba-208a-45bb-bda3-24dca42f8a4b req-81c79b74-a54f-40d7-8f97-3e79efcc4192 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-9d23c3ba-208a-45bb-bda3-24dca42f8a4b req-81c79b74-a54f-40d7-8f97-3e79efcc4192 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:22 user nova-compute[74932]: WARNING nova.compute.manager [req-9d23c3ba-208a-45bb-bda3-24dca42f8a4b req-81c79b74-a54f-40d7-8f97-3e79efcc4192 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f for instance with vm_state building and task_state spawning.
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-d282344b-37a8-45c3-bb3a-158fef9e49df req-39778ca9-d94e-49a7-a226-530020afa17c service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d282344b-37a8-45c3-bb3a-158fef9e49df req-39778ca9-d94e-49a7-a226-530020afa17c service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d282344b-37a8-45c3-bb3a-158fef9e49df req-39778ca9-d94e-49a7-a226-530020afa17c service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d282344b-37a8-45c3-bb3a-158fef9e49df req-39778ca9-d94e-49a7-a226-530020afa17c service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-d282344b-37a8-45c3-bb3a-158fef9e49df req-39778ca9-d94e-49a7-a226-530020afa17c service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:23 user nova-compute[74932]: WARNING nova.compute.manager [req-d282344b-37a8-45c3-bb3a-158fef9e49df req-39778ca9-d94e-49a7-a226-530020afa17c service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 for instance with vm_state building and task_state spawning.
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Successfully updated port: 0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Instance network_info: |[{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Start _get_guest_xml network_info=[{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:31:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-502484495',display_name='tempest-ServerActionsTestOtherA-server-502484495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-502484495',id=20,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-f801r0ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=0d0016ac-ccd0-45b7-936b-ff0da827760b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.objects.instance [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d0016ac-ccd0-45b7-936b-ff0da827760b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:31:24 user nova-compute[74932]:   <uuid>0d0016ac-ccd0-45b7-936b-ff0da827760b</uuid>
Nov 03 16:31:24 user nova-compute[74932]:   <name>instance-00000014</name>
Nov 03 16:31:24 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:31:24 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:31:24 user nova-compute[74932]:   <metadata>
Nov 03 16:31:24 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:31:24 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:31:24 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherA-server-502484495</nova:name>
Nov 03 16:31:24 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:31:24</nova:creationTime>
Nov 03 16:31:24 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:31:24 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:31:24 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:31:24 user nova-compute[74932]:       <nova:owner>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:user uuid="90fa01b533204995b57b88b0a4aac138">tempest-ServerActionsTestOtherA-1516695200-project-member</nova:user>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:project uuid="9a8cbb942aff476ebf7cca3968447573">tempest-ServerActionsTestOtherA-1516695200</nova:project>
Nov 03 16:31:24 user nova-compute[74932]:       </nova:owner>
Nov 03 16:31:24 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:31:24 user nova-compute[74932]:       <nova:ports>
Nov 03 16:31:24 user nova-compute[74932]:         <nova:port uuid="0c575c5b-4834-49fc-85bc-19b531842c25">
Nov 03 16:31:24 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:31:24 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:24 user nova-compute[74932]:       </nova:ports>
Nov 03 16:31:24 user nova-compute[74932]:     </nova:instance>
Nov 03 16:31:24 user nova-compute[74932]:   </metadata>
Nov 03 16:31:24 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:31:24 user nova-compute[74932]:     <system>
Nov 03 16:31:24 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:31:24 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:31:24 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:31:24 user nova-compute[74932]:       <entry name="serial">0d0016ac-ccd0-45b7-936b-ff0da827760b</entry>
Nov 03 16:31:24 user nova-compute[74932]:       <entry name="uuid">0d0016ac-ccd0-45b7-936b-ff0da827760b</entry>
Nov 03 16:31:24 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:31:24 user nova-compute[74932]:     </system>
Nov 03 16:31:24 user nova-compute[74932]:   </sysinfo>
Nov 03 16:31:24 user nova-compute[74932]:   <os>
Nov 03 16:31:24 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:31:24 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:31:24 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:31:24 user nova-compute[74932]:   </os>
Nov 03 16:31:24 user nova-compute[74932]:   <features>
Nov 03 16:31:24 user nova-compute[74932]:     <acpi/>
Nov 03 16:31:24 user nova-compute[74932]:     <apic/>
Nov 03 16:31:24 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:31:24 user nova-compute[74932]:   </features>
Nov 03 16:31:24 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:31:24 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:31:24 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:31:24 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:31:24 user nova-compute[74932]:   </clock>
Nov 03 16:31:24 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:31:24 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:31:24 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:31:24 user nova-compute[74932]:   </cpu>
Nov 03 16:31:24 user nova-compute[74932]:   <devices>
Nov 03 16:31:24 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:31:24 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:31:24 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk"/>
Nov 03 16:31:24 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:31:24 user nova-compute[74932]:     </disk>
Nov 03 16:31:24 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:24 user nova-compute[74932]:       <mac address="fa:16:3e:3e:33:ed"/>
Nov 03 16:31:24 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:24 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:24 user nova-compute[74932]:       <target dev="tap0c575c5b-48"/>
Nov 03 16:31:24 user nova-compute[74932]:     </interface>
Nov 03 16:31:24 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:31:24 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/console.log" append="off"/>
Nov 03 16:31:24 user nova-compute[74932]:     </serial>
Nov 03 16:31:24 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:31:24 user nova-compute[74932]:     <video>
Nov 03 16:31:24 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:24 user nova-compute[74932]:     </video>
Nov 03 16:31:24 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:31:24 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:31:24 user nova-compute[74932]:     </rng>
Nov 03 16:31:24 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:31:24 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:31:24 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:31:24 user nova-compute[74932]:     </memballoon>
Nov 03 16:31:24 user nova-compute[74932]:   </devices>
Nov 03 16:31:24 user nova-compute[74932]: </domain>
Nov 03 16:31:24 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-502484495',display_name='tempest-ServerActionsTestOtherA-server-502484495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-502484495',id=20,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-f801r0ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=0d0016ac-ccd0-45b7-936b-ff0da827760b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG os_vif [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdcce9cf-19f9-5caf-9ad6-99cc38a1d379', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c575c5b-48, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c575c5b-48, col_values=(('qos', UUID('652399e1-3683-4f4f-86cf-42926390ce37')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c575c5b-48, col_values=(('external_ids', {'iface-id': '0c575c5b-4834-49fc-85bc-19b531842c25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:33:ed', 'vm-uuid': '0d0016ac-ccd0-45b7-936b-ff0da827760b'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: INFO os_vif [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48')
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:24 user nova-compute[74932]: WARNING nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 for instance with vm_state building and task_state spawning.
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:24 user nova-compute[74932]: WARNING nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 for instance with vm_state building and task_state spawning.
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:24 user nova-compute[74932]: WARNING nova.compute.manager [req-7924daa4-39a9-4f87-a960-d180fe91a7db req-5896dcbf-f610-430f-95b1-1f486a0e7af8 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 for instance with vm_state building and task_state spawning.
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No VIF found with MAC fa:16:3e:3e:33:ed, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:24 user nova-compute[74932]: WARNING nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f for instance with vm_state building and task_state spawning.
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-changed-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Refreshing instance network info cache due to event network-changed-0c575c5b-4834-49fc-85bc-19b531842c25. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:24 user nova-compute[74932]: DEBUG nova.network.neutron [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Refreshing network info cache for port 0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updated VIF entry in instance network info cache for port 0c575c5b-4834-49fc-85bc-19b531842c25. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:25 user nova-compute[74932]: WARNING nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 for instance with vm_state building and task_state spawning.
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:25 user nova-compute[74932]: WARNING nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 for instance with vm_state building and task_state spawning.
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:25 user nova-compute[74932]: WARNING nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 for instance with vm_state building and task_state spawning.
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:25 user nova-compute[74932]: WARNING nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 for instance with vm_state building and task_state spawning.
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:25 user nova-compute[74932]: WARNING nova.compute.manager [req-3f85b92d-1c83-4409-b95f-6c9d92311e86 req-eae43340-e534-4845-989a-fb87a6e93d01 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 for instance with vm_state building and task_state spawning.
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-14dab19e-31dc-4564-ad7a-ab10ef6eba11 req-64863786-535d-4ddb-be9e-e80faf812ac7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-14dab19e-31dc-4564-ad7a-ab10ef6eba11 req-64863786-535d-4ddb-be9e-e80faf812ac7 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-14dab19e-31dc-4564-ad7a-ab10ef6eba11 req-64863786-535d-4ddb-be9e-e80faf812ac7 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-14dab19e-31dc-4564-ad7a-ab10ef6eba11 req-64863786-535d-4ddb-be9e-e80faf812ac7 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-14dab19e-31dc-4564-ad7a-ab10ef6eba11 req-64863786-535d-4ddb-be9e-e80faf812ac7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:25 user nova-compute[74932]: WARNING nova.compute.manager [req-14dab19e-31dc-4564-ad7a-ab10ef6eba11 req-64863786-535d-4ddb-be9e-e80faf812ac7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 for instance with vm_state building and task_state spawning.
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:26 user nova-compute[74932]: WARNING nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 for instance with vm_state building and task_state spawning.
Nov 03 16:31:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] No waiting events found dispatching network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:26 user nova-compute[74932]: WARNING nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received unexpected event network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 for instance with vm_state building and task_state spawning.
Nov 03 16:31:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] No waiting events found dispatching network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:26 user nova-compute[74932]: WARNING nova.compute.manager [req-1149bce3-e2e0-41c9-abb5-f8a2fb9c2491 req-1f95624c-fa30-4872-8ce4-60d786a5c4a1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received unexpected event network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 for instance with vm_state building and task_state spawning.
Nov 03 16:31:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:31:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance spawned successfully.
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:27 user nova-compute[74932]: INFO nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Took 13.46 seconds to spawn the instance on the hypervisor.
Nov 03 16:31:27 user nova-compute[74932]: DEBUG nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:31:28 user nova-compute[74932]: INFO nova.compute.manager [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Took 84.32 seconds to build instance.
Nov 03 16:31:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e287b838-368c-477a-b78c-808ee12d49cc tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 84.464s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:31:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Instance spawned successfully.
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:31:28 user nova-compute[74932]: INFO nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 03 16:31:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:31:28 user nova-compute[74932]: INFO nova.compute.manager [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Took 7.81 seconds to build instance.
Nov 03 16:31:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-144f904c-76e1-40f3-b655-775ee6a4170a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.009s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:40 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:42 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:31:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:31:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updating instance_info_cache with network_info: [{"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-391f8ba7-9f07-474e-b606-1abb8c9b3dee" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:31:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:31:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:31:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:31:53 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:53 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.406417846679688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1b97e423-b373-4f86-8ad7-281b30af23ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 358b33c3-c1e4-4f79-a5e0-0b60b9205339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:31:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e56b15a2-5641-442d-ac1a-3670f44dfd45 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.290s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:31:54 user nova-compute[74932]: INFO nova.compute.claims [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Claim successful on node user
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:31:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:31:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.policy [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b38a6d5ffa86469f96fc1a5f5b920f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eba13b452ca4bd7ab3950b3989efbda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:31:55 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Creating image(s)
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "/opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "/opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "/opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.232s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk 1073741824" returned: 0 in 0.063s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Successfully created port: 241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.216s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Cannot resize image /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Ensure instance console log exists: /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Successfully updated port: 241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "refresh_cache-e56b15a2-5641-442d-ac1a-3670f44dfd45" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquired lock "refresh_cache-e56b15a2-5641-442d-ac1a-3670f44dfd45" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-changed-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Refreshing instance network info cache due to event network-changed-241269a6-fe50-4995-b617-550c772a2b85. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] Acquiring lock "refresh_cache-e56b15a2-5641-442d-ac1a-3670f44dfd45" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Updating instance_info_cache with network_info: [{"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Releasing lock "refresh_cache-e56b15a2-5641-442d-ac1a-3670f44dfd45" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Instance network_info: |[{"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] Acquired lock "refresh_cache-e56b15a2-5641-442d-ac1a-3670f44dfd45" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Refreshing network info cache for port 241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Start _get_guest_xml network_info=[{"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:31:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-75489420',display_name='tempest-DeleteServersTestJSON-server-75489420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-75489420',id=21,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eba13b452ca4bd7ab3950b3989efbda',ramdisk_id='',reservation_id='r-jg7l73ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1056720046',owner_user_name='tempest-DeleteServersTestJSON-1056720046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:31:55Z,user_data=None,user_id='b38a6d5ffa86469f96fc1a5f5b920f25',uuid=e56b15a2-5641-442d-ac1a-3670f44dfd45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Converting VIF {"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lazy-loading 'pci_devices' on Instance uuid e56b15a2-5641-442d-ac1a-3670f44dfd45 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:31:56 user nova-compute[74932]:   <uuid>e56b15a2-5641-442d-ac1a-3670f44dfd45</uuid>
Nov 03 16:31:56 user nova-compute[74932]:   <name>instance-00000015</name>
Nov 03 16:31:56 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:31:56 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:31:56 user nova-compute[74932]:   <metadata>
Nov 03 16:31:56 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:31:56 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:31:56 user nova-compute[74932]:       <nova:name>tempest-DeleteServersTestJSON-server-75489420</nova:name>
Nov 03 16:31:56 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:31:56</nova:creationTime>
Nov 03 16:31:56 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:31:56 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:31:56 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:31:56 user nova-compute[74932]:       <nova:owner>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:user uuid="b38a6d5ffa86469f96fc1a5f5b920f25">tempest-DeleteServersTestJSON-1056720046-project-member</nova:user>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:project uuid="2eba13b452ca4bd7ab3950b3989efbda">tempest-DeleteServersTestJSON-1056720046</nova:project>
Nov 03 16:31:56 user nova-compute[74932]:       </nova:owner>
Nov 03 16:31:56 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:31:56 user nova-compute[74932]:       <nova:ports>
Nov 03 16:31:56 user nova-compute[74932]:         <nova:port uuid="241269a6-fe50-4995-b617-550c772a2b85">
Nov 03 16:31:56 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 16:31:56 user nova-compute[74932]:         </nova:port>
Nov 03 16:31:56 user nova-compute[74932]:       </nova:ports>
Nov 03 16:31:56 user nova-compute[74932]:     </nova:instance>
Nov 03 16:31:56 user nova-compute[74932]:   </metadata>
Nov 03 16:31:56 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:31:56 user nova-compute[74932]:     <system>
Nov 03 16:31:56 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:31:56 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:31:56 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:31:56 user nova-compute[74932]:       <entry name="serial">e56b15a2-5641-442d-ac1a-3670f44dfd45</entry>
Nov 03 16:31:56 user nova-compute[74932]:       <entry name="uuid">e56b15a2-5641-442d-ac1a-3670f44dfd45</entry>
Nov 03 16:31:56 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:31:56 user nova-compute[74932]:     </system>
Nov 03 16:31:56 user nova-compute[74932]:   </sysinfo>
Nov 03 16:31:56 user nova-compute[74932]:   <os>
Nov 03 16:31:56 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:31:56 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:31:56 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:31:56 user nova-compute[74932]:   </os>
Nov 03 16:31:56 user nova-compute[74932]:   <features>
Nov 03 16:31:56 user nova-compute[74932]:     <acpi/>
Nov 03 16:31:56 user nova-compute[74932]:     <apic/>
Nov 03 16:31:56 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:31:56 user nova-compute[74932]:   </features>
Nov 03 16:31:56 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:31:56 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:31:56 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:31:56 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:31:56 user nova-compute[74932]:   </clock>
Nov 03 16:31:56 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:31:56 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:31:56 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:31:56 user nova-compute[74932]:   </cpu>
Nov 03 16:31:56 user nova-compute[74932]:   <devices>
Nov 03 16:31:56 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:31:56 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:31:56 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk"/>
Nov 03 16:31:56 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:31:56 user nova-compute[74932]:     </disk>
Nov 03 16:31:56 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:31:56 user nova-compute[74932]:       <mac address="fa:16:3e:12:3d:76"/>
Nov 03 16:31:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:56 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:31:56 user nova-compute[74932]:       <target dev="tap241269a6-fe"/>
Nov 03 16:31:56 user nova-compute[74932]:     </interface>
Nov 03 16:31:56 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:31:56 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/console.log" append="off"/>
Nov 03 16:31:56 user nova-compute[74932]:     </serial>
Nov 03 16:31:56 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:31:56 user nova-compute[74932]:     <video>
Nov 03 16:31:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:31:56 user nova-compute[74932]:     </video>
Nov 03 16:31:56 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:31:56 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:31:56 user nova-compute[74932]:     </rng>
Nov 03 16:31:56 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:31:56 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:31:56 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:31:56 user nova-compute[74932]:     </memballoon>
Nov 03 16:31:56 user nova-compute[74932]:   </devices>
Nov 03 16:31:56 user nova-compute[74932]: </domain>
Nov 03 16:31:56 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-75489420',display_name='tempest-DeleteServersTestJSON-server-75489420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-75489420',id=21,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2eba13b452ca4bd7ab3950b3989efbda',ramdisk_id='',reservation_id='r-jg7l73ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1056720046',owner_user_name='tempest-DeleteServersTestJSON-1056720046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:31:55Z,user_data=None,user_id='b38a6d5ffa86469f96fc1a5f5b920f25',uuid=e56b15a2-5641-442d-ac1a-3670f44dfd45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Converting VIF {"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG os_vif [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a2932cd-dacf-5abb-a26e-06a38fa467a8', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap241269a6-fe, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap241269a6-fe, col_values=(('qos', UUID('db289610-a3f0-4574-a535-ee8ed67c8e92')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap241269a6-fe, col_values=(('external_ids', {'iface-id': '241269a6-fe50-4995-b617-550c772a2b85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:3d:76', 'vm-uuid': 'e56b15a2-5641-442d-ac1a-3670f44dfd45'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:56 user nova-compute[74932]: INFO os_vif [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe')
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:31:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] No VIF found with MAC fa:16:3e:12:3d:76, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:31:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Updated VIF entry in instance network info cache for port 241269a6-fe50-4995-b617-550c772a2b85. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:31:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Updating instance_info_cache with network_info: [{"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:31:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b4e00dd9-a5ef-46e4-a981-6efceed50e07 req-6e481945-5904-4cd4-8740-69484996c656 service nova] Releasing lock "refresh_cache-e56b15a2-5641-442d-ac1a-3670f44dfd45" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:31:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:31:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-a3b50e5f-aa84-4253-aa9f-77c10124f69e req-fdea5887-1c6c-45e1-a6a9-a7949c9cddb3 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a3b50e5f-aa84-4253-aa9f-77c10124f69e req-fdea5887-1c6c-45e1-a6a9-a7949c9cddb3 service nova] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a3b50e5f-aa84-4253-aa9f-77c10124f69e req-fdea5887-1c6c-45e1-a6a9-a7949c9cddb3 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a3b50e5f-aa84-4253-aa9f-77c10124f69e req-fdea5887-1c6c-45e1-a6a9-a7949c9cddb3 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:31:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-a3b50e5f-aa84-4253-aa9f-77c10124f69e req-fdea5887-1c6c-45e1-a6a9-a7949c9cddb3 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] No waiting events found dispatching network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:31:59 user nova-compute[74932]: WARNING nova.compute.manager [req-a3b50e5f-aa84-4253-aa9f-77c10124f69e req-fdea5887-1c6c-45e1-a6a9-a7949c9cddb3 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received unexpected event network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 for instance with vm_state building and task_state spawning.
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:32:00 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Instance spawned successfully.
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:32:00 user nova-compute[74932]: INFO nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 03 16:32:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:32:00 user nova-compute[74932]: INFO nova.compute.manager [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Took 6.89 seconds to build instance.
Nov 03 16:32:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ecb8cdd6-da9a-45c5-960b-dbdb742892dd tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-7635c049-f9fb-4bbc-96c1-1c2b82976964 req-0de13a97-90a9-446f-8805-1b98cc590430 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7635c049-f9fb-4bbc-96c1-1c2b82976964 req-0de13a97-90a9-446f-8805-1b98cc590430 service nova] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7635c049-f9fb-4bbc-96c1-1c2b82976964 req-0de13a97-90a9-446f-8805-1b98cc590430 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7635c049-f9fb-4bbc-96c1-1c2b82976964 req-0de13a97-90a9-446f-8805-1b98cc590430 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-7635c049-f9fb-4bbc-96c1-1c2b82976964 req-0de13a97-90a9-446f-8805-1b98cc590430 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] No waiting events found dispatching network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:01 user nova-compute[74932]: WARNING nova.compute.manager [req-7635c049-f9fb-4bbc-96c1-1c2b82976964 req-0de13a97-90a9-446f-8805-1b98cc590430 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received unexpected event network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 for instance with vm_state active and task_state None.
Nov 03 16:32:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:12 user nova-compute[74932]: INFO nova.compute.manager [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Terminating instance
Nov 03 16:32:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-66b9b563-791a-4ee2-9713-7e3244f35bfd req-c8bf32d4-3a3a-45e5-8e5f-1d89b92b7f44 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-vif-unplugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-66b9b563-791a-4ee2-9713-7e3244f35bfd req-c8bf32d4-3a3a-45e5-8e5f-1d89b92b7f44 service nova] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-66b9b563-791a-4ee2-9713-7e3244f35bfd req-c8bf32d4-3a3a-45e5-8e5f-1d89b92b7f44 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-66b9b563-791a-4ee2-9713-7e3244f35bfd req-c8bf32d4-3a3a-45e5-8e5f-1d89b92b7f44 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-66b9b563-791a-4ee2-9713-7e3244f35bfd req-c8bf32d4-3a3a-45e5-8e5f-1d89b92b7f44 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] No waiting events found dispatching network-vif-unplugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-66b9b563-791a-4ee2-9713-7e3244f35bfd req-c8bf32d4-3a3a-45e5-8e5f-1d89b92b7f44 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-vif-unplugged-570732af-1616-4ec1-ba22-db22e3695659 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Instance destroyed successfully.
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lazy-loading 'resources' on Instance uuid d94f2ba8-e23e-497c-aa29-b282d9bd79e9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1598000502',display_name='tempest-ServersNegativeTestJSON-server-1598000502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1598000502',id=1,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:23:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a0b7a96b7504dd786bb63ee5504b40d',ramdisk_id='',reservation_id='r-ol6mhx7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1609048425',owner_user_name='tempest-ServersNegativeTestJSON-1609048425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:23:06Z,user_data=None,user_id='c4bb8e6d69e4480983150ec4cd23a270',uuid=d94f2ba8-e23e-497c-aa29-b282d9bd79e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converting VIF {"id": "570732af-1616-4ec1-ba22-db22e3695659", "address": "fa:16:3e:41:0e:3b", "network": {"id": "7424ba8b-e976-4b3b-b835-a7038943b368", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1970356433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0b7a96b7504dd786bb63ee5504b40d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570732af-16", "ovs_interfaceid": "570732af-1616-4ec1-ba22-db22e3695659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG os_vif [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap570732af-16, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0166b963-c956-46eb-a8ed-2d61de3b2059) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:13 user nova-compute[74932]: INFO os_vif [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=570732af-1616-4ec1-ba22-db22e3695659,network=Network(7424ba8b-e976-4b3b-b835-a7038943b368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570732af-16')
Nov 03 16:32:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Deleting instance files /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9_del
Nov 03 16:32:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Deletion of /opt/stack/data/nova/instances/d94f2ba8-e23e-497c-aa29-b282d9bd79e9_del complete
Nov 03 16:32:13 user nova-compute[74932]: INFO nova.compute.manager [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 03 16:32:13 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:32:13 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:32:14 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:14 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Took 0.49 seconds to deallocate network for instance.
Nov 03 16:32:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:32:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:32:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:14 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Deleted allocations for instance d94f2ba8-e23e-497c-aa29-b282d9bd79e9
Nov 03 16:32:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a5151b02-7125-4bb2-ab96-19f3d1f002f8 tempest-ServersNegativeTestJSON-1609048425 tempest-ServersNegativeTestJSON-1609048425-project-member] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] Acquiring lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] Lock "d94f2ba8-e23e-497c-aa29-b282d9bd79e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] No waiting events found dispatching network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:15 user nova-compute[74932]: WARNING nova.compute.manager [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received unexpected event network-vif-plugged-570732af-1616-4ec1-ba22-db22e3695659 for instance with vm_state deleted and task_state None.
Nov 03 16:32:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-9f7ae1a0-108a-4615-bb2e-3e5c1607064e req-65a7d1da-9cb3-438e-8319-3372c7498de5 service nova] [instance: d94f2ba8-e23e-497c-aa29-b282d9bd79e9] Received event network-vif-deleted-570732af-1616-4ec1-ba22-db22e3695659 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-changed-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Refreshing instance network info cache due to event network-changed-d809cace-ae35-4d72-83fb-e0e4a83ea558. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] Acquiring lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] Acquired lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG nova.network.neutron [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Refreshing network info cache for port d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG nova.network.neutron [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updated VIF entry in instance network info cache for port d809cace-ae35-4d72-83fb-e0e4a83ea558. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG nova.network.neutron [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e3fb1ee1-4170-465c-9dea-1907798795a5 req-122358ba-457e-4e63-b8ef-dfa63cc74d6b service nova] Releasing lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:32:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:41 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:43 user nova-compute[74932]: INFO nova.compute.manager [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Shelving
Nov 03 16:32:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-dc8dd358-79a1-4949-9dfd-20a80dd7f468 req-dce95b02-42d8-42b6-9ee2-235beda573d5 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-unplugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-dc8dd358-79a1-4949-9dfd-20a80dd7f468 req-dce95b02-42d8-42b6-9ee2-235beda573d5 service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-dc8dd358-79a1-4949-9dfd-20a80dd7f468 req-dce95b02-42d8-42b6-9ee2-235beda573d5 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-dc8dd358-79a1-4949-9dfd-20a80dd7f468 req-dce95b02-42d8-42b6-9ee2-235beda573d5 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-dc8dd358-79a1-4949-9dfd-20a80dd7f468 req-dce95b02-42d8-42b6-9ee2-235beda573d5 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-unplugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:43 user nova-compute[74932]: WARNING nova.compute.manager [req-dc8dd358-79a1-4949-9dfd-20a80dd7f468 req-dce95b02-42d8-42b6-9ee2-235beda573d5 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-unplugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state active and task_state shelving.
Nov 03 16:32:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:43 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance destroyed successfully.
Nov 03 16:32:43 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Beginning cold snapshot process
Nov 03 16:32:43 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:32:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk /opt/stack/data/nova/instances/snapshots/tmp2n7sm8kb/ce761b1602234ea186e8f218b6a48de6 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:32:44 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk /opt/stack/data/nova/instances/snapshots/tmp2n7sm8kb/ce761b1602234ea186e8f218b6a48de6" returned: 0 in 1.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Snapshot extracted, beginning image upload
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:45 user nova-compute[74932]: INFO nova.compute.manager [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Terminating instance
Nov 03 16:32:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-c31dd72c-301e-48e7-92f5-567e23b99935 req-af282707-dbc3-4a0f-b832-d699e981b535 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c31dd72c-301e-48e7-92f5-567e23b99935 req-af282707-dbc3-4a0f-b832-d699e981b535 service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c31dd72c-301e-48e7-92f5-567e23b99935 req-af282707-dbc3-4a0f-b832-d699e981b535 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c31dd72c-301e-48e7-92f5-567e23b99935 req-af282707-dbc3-4a0f-b832-d699e981b535 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-c31dd72c-301e-48e7-92f5-567e23b99935 req-af282707-dbc3-4a0f-b832-d699e981b535 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:45 user nova-compute[74932]: WARNING nova.compute.manager [req-c31dd72c-301e-48e7-92f5-567e23b99935 req-af282707-dbc3-4a0f-b832-d699e981b535 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 16:32:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-01ff9860-a534-48e0-baac-4cd034a97ec6 req-cb31b260-2c4e-463e-a8a9-d697a101ca0b service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-01ff9860-a534-48e0-baac-4cd034a97ec6 req-cb31b260-2c4e-463e-a8a9-d697a101ca0b service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-01ff9860-a534-48e0-baac-4cd034a97ec6 req-cb31b260-2c4e-463e-a8a9-d697a101ca0b service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-01ff9860-a534-48e0-baac-4cd034a97ec6 req-cb31b260-2c4e-463e-a8a9-d697a101ca0b service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-01ff9860-a534-48e0-baac-4cd034a97ec6 req-cb31b260-2c4e-463e-a8a9-d697a101ca0b service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-01ff9860-a534-48e0-baac-4cd034a97ec6 req-cb31b260-2c4e-463e-a8a9-d697a101ca0b service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-unplugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [{"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Instance destroyed successfully.
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.objects.instance [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lazy-loading 'resources' on Instance uuid cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:22:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-103654683',display_name='tempest-ServerActionsTestOtherB-server-103654683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-103654683',id=3,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPYK4WOE9jK9pu5oVg3lbWqhkRULYS1vc0Nr/3GVzd9Nz/GEz9ndnvR37q7o8bw5kOuY/qrSWTndDqNBskRf8C/2c0eEIpmy3UDxe/w099MSu0S9uaZ5LLlsgnXEAaKw==',key_name='tempest-keypair-855983550',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:30:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4a734f8e7b34fd1b14f878955a48490',ramdisk_id='',reservation_id='r-d9036c44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2075500504',owner_user_name='tempest-ServerActionsTestOtherB-2075500504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd6f5749c77427883db867a8de18c2f',uuid=cb4bd028-91a8-489d-ab27-e5dc6d75a7b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converting VIF {"id": "7ab56479-82d0-433f-a971-d25a3edff1ed", "address": "fa:16:3e:d0:fa:36", "network": {"id": "399eee60-13ed-44fe-9247-2cc351d046bb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1196624487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4a734f8e7b34fd1b14f878955a48490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab56479-82", "ovs_interfaceid": "7ab56479-82d0-433f-a971-d25a3edff1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_vif [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ab56479-82, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=592e3583-64cb-462f-8687-bf4649ac9970) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:46 user nova-compute[74932]: INFO os_vif [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fa:36,bridge_name='br-int',has_traffic_filtering=True,id=7ab56479-82d0-433f-a971-d25a3edff1ed,network=Network(399eee60-13ed-44fe-9247-2cc351d046bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab56479-82')
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETVOdxnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:32:46 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f83067-43a7-460f-9eee-d4eb6f95ff1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:32:46 user nova-compute[74932]: No targets found.
Nov 03 16:32:46 user nova-compute[74932]: iSNS:
Nov 03 16:32:46 user nova-compute[74932]: No targets found.
Nov 03 16:32:46 user nova-compute[74932]: STATIC:
Nov 03 16:32:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62
Nov 03 16:32:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f
Nov 03 16:32:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51
Nov 03 16:32:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88
Nov 03 16:32:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:46 user nova-compute[74932]: FIRMWARE:
Nov 03 16:32:46 user nova-compute[74932]: No targets found.
Nov 03 16:32:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:32:46 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:32:46 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d519741b-e7bf-437d-9025-dc133a4c844d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cff0b0-efc5-49d0-b410-83d33bcca844]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:32:46 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:32:46 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:32:46 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f (non-flash)
Nov 03 16:32:46 user nova-compute[74932]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:32:46 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:32:46 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64499ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6909e-8505-4028-bdcc-fe6226bf850b]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f248487-a34a-48d7-acc4-ae70bfc39de9]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4d48f8-0833-4714-9ae4-cd542c4ae666]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-changed-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing instance network info cache due to event network-changed-1abb133f-d6e7-4993-a37b-abe7343e75b0. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] Acquiring lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] Acquired lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Refreshing network info cache for port 1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f07c5f-6e9e-4bd5-b423-65b5a08ce60c]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7438fe-6c9a-4890-b10f-e4c6f4af52f8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5e8f2b-21a1-4658-9bf1-0be8dbcacc7f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260]
Nov 03 16:32:46 user nova-compute[74932]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f, portal: 172.16.0.220,3260] successful.
Nov 03 16:32:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b5fdcc-d757-449e-ae07-198e9d622b2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a2b77c-9249-4cce-8366-f9e033c206dc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] <== disconnect_volume: return (377ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:32:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Deleting instance files /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7_del
Nov 03 16:32:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Deletion of /opt/stack/data/nova/instances/cb4bd028-91a8-489d-ab27-e5dc6d75a7b7_del complete
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:46 user nova-compute[74932]: INFO nova.compute.manager [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 03 16:32:46 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updated VIF entry in instance network info cache for port 1abb133f-d6e7-4993-a37b-abe7343e75b0. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:32:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b6a6ec40-c117-47c1-8170-53c7a8f80351 req-00ca5a65-6ac3-45c7-866a-ae9b6fb4b9ab service nova] Releasing lock "refresh_cache-f8c9cca7-1c97-4af8-9c7d-c823330e507c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:32:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-88827c54-199b-4148-89f0-3ac41233c633 req-da90ece0-572e-4829-9c38-e7aa79d3b3a2 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-88827c54-199b-4148-89f0-3ac41233c633 req-da90ece0-572e-4829-9c38-e7aa79d3b3a2 service nova] Acquiring lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-88827c54-199b-4148-89f0-3ac41233c633 req-da90ece0-572e-4829-9c38-e7aa79d3b3a2 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-88827c54-199b-4148-89f0-3ac41233c633 req-da90ece0-572e-4829-9c38-e7aa79d3b3a2 service nova] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-88827c54-199b-4148-89f0-3ac41233c633 req-da90ece0-572e-4829-9c38-e7aa79d3b3a2 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] No waiting events found dispatching network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:47 user nova-compute[74932]: WARNING nova.compute.manager [req-88827c54-199b-4148-89f0-3ac41233c633 req-da90ece0-572e-4829-9c38-e7aa79d3b3a2 service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received unexpected event network-vif-plugged-7ab56479-82d0-433f-a971-d25a3edff1ed for instance with vm_state active and task_state deleting.
Nov 03 16:32:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:48 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Took 1.42 seconds to deallocate network for instance.
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-a55262e7-0bf3-46cc-a367-9567f9fbe9ca req-be566abb-408c-4f4d-933c-bb991c57977c service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Received event network-vif-deleted-7ab56479-82d0-433f-a971-d25a3edff1ed {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:48 user nova-compute[74932]: INFO nova.compute.manager [req-a55262e7-0bf3-46cc-a367-9567f9fbe9ca req-be566abb-408c-4f4d-933c-bb991c57977c service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Neutron deleted interface 7ab56479-82d0-433f-a971-d25a3edff1ed; detaching it from the instance and deleting it from the info cache
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.network.neutron [req-a55262e7-0bf3-46cc-a367-9567f9fbe9ca req-be566abb-408c-4f4d-933c-bb991c57977c service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-a55262e7-0bf3-46cc-a367-9567f9fbe9ca req-be566abb-408c-4f4d-933c-bb991c57977c service nova] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Detach interface failed, port_id=7ab56479-82d0-433f-a971-d25a3edff1ed, reason: Instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:32:48 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Snapshot image upload complete
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:32:48 user nova-compute[74932]: INFO nova.compute.manager [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Rescuing
Nov 03 16:32:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:32:48 user nova-compute[74932]: INFO nova.compute.manager [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Shelve offloading
Nov 03 16:32:48 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance destroyed successfully.
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquired lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Releasing lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.compute.manager [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] [instance: cb4bd028-91a8-489d-ab27-e5dc6d75a7b7] Took 1.15 seconds to detach 1 volumes for instance.
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-63d731ed-cbbf-4e8d-89e1-64930cf70c5d req-024a55a5-3d7d-4675-b0b5-a435bc15b8bf service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-unplugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-63d731ed-cbbf-4e8d-89e1-64930cf70c5d req-024a55a5-3d7d-4675-b0b5-a435bc15b8bf service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-63d731ed-cbbf-4e8d-89e1-64930cf70c5d req-024a55a5-3d7d-4675-b0b5-a435bc15b8bf service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-63d731ed-cbbf-4e8d-89e1-64930cf70c5d req-024a55a5-3d7d-4675-b0b5-a435bc15b8bf service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-63d731ed-cbbf-4e8d-89e1-64930cf70c5d req-024a55a5-3d7d-4675-b0b5-a435bc15b8bf service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-unplugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:49 user nova-compute[74932]: WARNING nova.compute.manager [req-63d731ed-cbbf-4e8d-89e1-64930cf70c5d req-024a55a5-3d7d-4675-b0b5-a435bc15b8bf service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-unplugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state active and task_state rescuing.
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Deleted allocations for instance cb4bd028-91a8-489d-ab27-e5dc6d75a7b7
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.compute.manager [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Terminating instance
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance destroyed successfully.
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance destroyed successfully.
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'resources' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Attempting rescue
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74932) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Creating image(s)
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768994889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768994889',id=17,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMg74tpn1Jh2l3/7bwzbGi29wVQa00Lqdj4LoxlzHfDbzcXqn3iwMNhc9A5CxZx3hemUyqu+0fxA7FI9X4Jgw+Z5OuNrS2thzUQ/YToMjxpJ1BNU/iHRky+89bhEdyD5g==',key_name='tempest-keypair-360156465',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-oyk2eyi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member',shelved_at='2023-11-03T16:32:48.245807',shelved_host='user',shelved_image_id='52bae536-a588-4148-b555-4c31b7c0e2a5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=358b33c3-c1e4-4f79-a5e0-0b60b9205339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG os_vif [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd809cace-ae, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0cc75d6-d1de-4a80-921b-e58684318f20) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-30ce32fd-a729-417c-8dc6-ba5dde82d356 tempest-ServerActionsTestOtherB-2075500504 tempest-ServerActionsTestOtherB-2075500504-project-member] Lock "cb4bd028-91a8-489d-ab27-e5dc6d75a7b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.543s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:49 user nova-compute[74932]: INFO os_vif [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae')
Nov 03 16:32:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Deleting instance files /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339_del
Nov 03 16:32:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Deletion of /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339_del complete
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.209s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue" returned: 0 in 0.079s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'migration_context' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.base [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<16bb1633-adf9-4889-a809-3e4eac1071b9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Start _get_guest_xml network_info=[{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:23:89:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'resources' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.base [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<16bb1633-adf9-4889-a809-3e4eac1071b9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'numa_topology' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c8c274c-3b18-413f-b6f4-856c65826cf5 req-95c9699b-47ac-4404-8861-83676a73f7c0 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c8c274c-3b18-413f-b6f4-856c65826cf5 req-95c9699b-47ac-4404-8861-83676a73f7c0 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c8c274c-3b18-413f-b6f4-856c65826cf5 req-95c9699b-47ac-4404-8861-83676a73f7c0 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c8c274c-3b18-413f-b6f4-856c65826cf5 req-95c9699b-47ac-4404-8861-83676a73f7c0 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c8c274c-3b18-413f-b6f4-856c65826cf5 req-95c9699b-47ac-4404-8861-83676a73f7c0 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c8c274c-3b18-413f-b6f4-856c65826cf5 req-95c9699b-47ac-4404-8861-83676a73f7c0 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.base [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<16bb1633-adf9-4889-a809-3e4eac1071b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:32:50 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Deleted allocations for instance 358b33c3-c1e4-4f79-a5e0-0b60b9205339
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:32:50 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.base [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<16bb1633-adf9-4889-a809-3e4eac1071b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-989134293',display_name='tempest-ServerRescueNegativeTestJSON-server-989134293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-989134293',id=19,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-lji0h7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:31:06Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=16bb1633-adf9-4889-a809-3e4eac1071b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:23:89:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:23:89:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'pci_devices' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'numa_topology' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.base [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<16bb1633-adf9-4889-a809-3e4eac1071b9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:32:50 user nova-compute[74932]:   <uuid>16bb1633-adf9-4889-a809-3e4eac1071b9</uuid>
Nov 03 16:32:50 user nova-compute[74932]:   <name>instance-00000013</name>
Nov 03 16:32:50 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:32:50 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:32:50 user nova-compute[74932]:   <metadata>
Nov 03 16:32:50 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:32:50 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:32:50 user nova-compute[74932]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-989134293</nova:name>
Nov 03 16:32:50 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:32:50</nova:creationTime>
Nov 03 16:32:50 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:32:50 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:32:50 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:32:50 user nova-compute[74932]:       <nova:owner>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:user uuid="462c0b16a5f744e49b3ee3ef8ee39e00">tempest-ServerRescueNegativeTestJSON-1518505179-project-member</nova:user>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:project uuid="dd1f1557f72d4ca1ac1d34772c23a953">tempest-ServerRescueNegativeTestJSON-1518505179</nova:project>
Nov 03 16:32:50 user nova-compute[74932]:       </nova:owner>
Nov 03 16:32:50 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:32:50 user nova-compute[74932]:       <nova:ports>
Nov 03 16:32:50 user nova-compute[74932]:         <nova:port uuid="6e55e6c0-b9a2-46a5-864b-fad6269714ea">
Nov 03 16:32:50 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:32:50 user nova-compute[74932]:         </nova:port>
Nov 03 16:32:50 user nova-compute[74932]:       </nova:ports>
Nov 03 16:32:50 user nova-compute[74932]:     </nova:instance>
Nov 03 16:32:50 user nova-compute[74932]:   </metadata>
Nov 03 16:32:50 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:32:50 user nova-compute[74932]:     <system>
Nov 03 16:32:50 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:32:50 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:32:50 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:32:50 user nova-compute[74932]:       <entry name="serial">16bb1633-adf9-4889-a809-3e4eac1071b9</entry>
Nov 03 16:32:50 user nova-compute[74932]:       <entry name="uuid">16bb1633-adf9-4889-a809-3e4eac1071b9</entry>
Nov 03 16:32:50 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:32:50 user nova-compute[74932]:     </system>
Nov 03 16:32:50 user nova-compute[74932]:   </sysinfo>
Nov 03 16:32:50 user nova-compute[74932]:   <os>
Nov 03 16:32:50 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:32:50 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:32:50 user nova-compute[74932]:   </os>
Nov 03 16:32:50 user nova-compute[74932]:   <features>
Nov 03 16:32:50 user nova-compute[74932]:     <acpi/>
Nov 03 16:32:50 user nova-compute[74932]:     <apic/>
Nov 03 16:32:50 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:32:50 user nova-compute[74932]:   </features>
Nov 03 16:32:50 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:32:50 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:32:50 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:32:50 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:32:50 user nova-compute[74932]:   </clock>
Nov 03 16:32:50 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:32:50 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:32:50 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:32:50 user nova-compute[74932]:   </cpu>
Nov 03 16:32:50 user nova-compute[74932]:   <devices>
Nov 03 16:32:50 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:32:50 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:32:50 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue"/>
Nov 03 16:32:50 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:32:50 user nova-compute[74932]:     </disk>
Nov 03 16:32:50 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:32:50 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:32:50 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk"/>
Nov 03 16:32:50 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:32:50 user nova-compute[74932]:     </disk>
Nov 03 16:32:50 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:32:50 user nova-compute[74932]:       <mac address="fa:16:3e:23:89:6c"/>
Nov 03 16:32:50 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:32:50 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:32:50 user nova-compute[74932]:       <target dev="tap6e55e6c0-b9"/>
Nov 03 16:32:50 user nova-compute[74932]:     </interface>
Nov 03 16:32:50 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:32:50 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/console.log" append="off"/>
Nov 03 16:32:50 user nova-compute[74932]:     </serial>
Nov 03 16:32:50 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:32:50 user nova-compute[74932]:     <video>
Nov 03 16:32:50 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:32:50 user nova-compute[74932]:     </video>
Nov 03 16:32:50 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:32:50 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:32:50 user nova-compute[74932]:     </rng>
Nov 03 16:32:50 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:32:50 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:32:50 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:32:50 user nova-compute[74932]:     </memballoon>
Nov 03 16:32:50 user nova-compute[74932]:   </devices>
Nov 03 16:32:50 user nova-compute[74932]: </domain>
Nov 03 16:32:50 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.objects.base [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<358b33c3-c1e4-4f79-a5e0-0b60b9205339> lazy-loaded attributes: resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:32:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance destroyed successfully.
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:23:89:6c, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-6ee0022b-45f1-49fc-837f-cbb0f0bd62f8 req-58d29c86-9ae3-44fb-8640-19b6abd2bcc9 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6ee0022b-45f1-49fc-837f-cbb0f0bd62f8 req-58d29c86-9ae3-44fb-8640-19b6abd2bcc9 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6ee0022b-45f1-49fc-837f-cbb0f0bd62f8 req-58d29c86-9ae3-44fb-8640-19b6abd2bcc9 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6ee0022b-45f1-49fc-837f-cbb0f0bd62f8 req-58d29c86-9ae3-44fb-8640-19b6abd2bcc9 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-6ee0022b-45f1-49fc-837f-cbb0f0bd62f8 req-58d29c86-9ae3-44fb-8640-19b6abd2bcc9 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-6ee0022b-45f1-49fc-837f-cbb0f0bd62f8 req-58d29c86-9ae3-44fb-8640-19b6abd2bcc9 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-b806163e-05c2-4c65-b7c6-9bd524d51962 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.121s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a0534c8b-7bae-4b48-948a-043e91c6dbe1 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.778s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: WARNING nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state active and task_state rescuing.
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: WARNING nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-4afaedc9-d29c-4d64-8bfe-96b70b3ec81f for instance with vm_state active and task_state deleting.
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-4f833233-310c-4d46-90f5-24b22a340ba6 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: WARNING nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-4f833233-310c-4d46-90f5-24b22a340ba6 for instance with vm_state active and task_state deleting.
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-da2d68a2-4bfd-494f-a06f-815126402456 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: WARNING nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-da2d68a2-4bfd-494f-a06f-815126402456 for instance with vm_state active and task_state deleting.
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-4eeb489a-2851-41b8-ab9d-7afb1263f54d req-5a67aec0-3bca-4a1f-94cf-f140fcf82e48 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-01e0d16c-3622-40ef-9fca-d86a087d7796 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:52 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Instance destroyed successfully.
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.objects.instance [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lazy-loading 'resources' on Instance uuid f8c9cca7-1c97-4af8-9c7d-c823330e507c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1abb133f-d6, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58251878-02bb-493e-88ae-254f494e65e7) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:52 user nova-compute[74932]: WARNING nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-1abb133f-d6e7-4993-a37b-abe7343e75b0 for instance with vm_state active and task_state deleting.
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-unplugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-unplugged-d4c7edf5-b485-4434-a7c3-4740df831df8 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:52 user nova-compute[74932]: WARNING nova.compute.manager [req-100882ea-4824-491f-97f8-fb4e12ba7fcf req-5b1801d9-73d0-4816-b5d0-12fede26b1f5 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-d4c7edf5-b485-4434-a7c3-4740df831df8 for instance with vm_state active and task_state deleting.
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1a:c4,bridge_name='br-int',has_traffic_filtering=True,id=1abb133f-d6e7-4993-a37b-abe7343e75b0,network=Network(42b46a4b-ddec-47d0-a4b0-3fe6b4043f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1abb133f-d6')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4afaedc9-d2, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0752c34d-c483-4565-bee9-c948a45d358b) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e7:18,bridge_name='br-int',has_traffic_filtering=True,id=4afaedc9-d29c-4d64-8bfe-96b70b3ec81f,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4afaedc9-d2')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4c7edf5-b4, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4dcb54c-8752-4a12-bc46-0d3d72fef083) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-520189ae-45f0-4842-b21f-1499f61da548 req-74d2b9c7-f569-41c9-8f8d-c4ad3091bc7a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-520189ae-45f0-4842-b21f-1499f61da548 req-74d2b9c7-f569-41c9-8f8d-c4ad3091bc7a service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-520189ae-45f0-4842-b21f-1499f61da548 req-74d2b9c7-f569-41c9-8f8d-c4ad3091bc7a service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-520189ae-45f0-4842-b21f-1499f61da548 req-74d2b9c7-f569-41c9-8f8d-c4ad3091bc7a service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-520189ae-45f0-4842-b21f-1499f61da548 req-74d2b9c7-f569-41c9-8f8d-c4ad3091bc7a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:52 user nova-compute[74932]: WARNING nova.compute.manager [req-520189ae-45f0-4842-b21f-1499f61da548 req-74d2b9c7-f569-41c9-8f8d-c4ad3091bc7a service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-b806163e-05c2-4c65-b7c6-9bd524d51962 for instance with vm_state active and task_state deleting.
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:27:83,bridge_name='br-int',has_traffic_filtering=True,id=d4c7edf5-b485-4434-a7c3-4740df831df8,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c7edf5-b4')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "b806163e-05c2-4c65-b7c6-9bd524d51962", "address": "fa:16:3e:74:48:40", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806163e-05", "ovs_interfaceid": "b806163e-05c2-4c65-b7c6-9bd524d51962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb806163e-05, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b9fa26c-65db-43e6-8c00-541c9c1654f0) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:48:40,bridge_name='br-int',has_traffic_filtering=True,id=b806163e-05c2-4c65-b7c6-9bd524d51962,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806163e-05')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f833233-31, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42a4ca40-8b52-424c-bac7-9ccd4d8012ef) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:98:1e,bridge_name='br-int',has_traffic_filtering=True,id=4f833233-310c-4d46-90f5-24b22a340ba6,network=Network(70cadeea-5403-4ede-b2aa-a8d515b41bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833233-31')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda2d68a2-4b, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bef766fa-a74f-4218-bf16-c2f3a4fea316) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:43:24,bridge_name='br-int',has_traffic_filtering=True,id=da2d68a2-4bfd-494f-a06f-815126402456,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda2d68a2-4b')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T16:30:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1838768569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1838768569',id=16,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtgP3d2Vp/GJOngzfSiAOlScfA8pJuqEYLSJIizs6LCgBGx7umHc/gBHBUIcNOf6XyHmVbIYHiFLIunbY9J+GdIyXaOev7r6eTJ6Rhy4GNCc1kBJYTcdOP3buO9ClNqlA==',key_name='tempest-keypair-1481969010',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846c49ad0b704a60b8bc3b11cdaace79',ramdisk_id='',reservation_id='r-zjgtgm4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2142622839',owner_user_name='tempest-TaggedBootDevicesTest_v242-2142622839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64e88e0fca994117a979a0e664b01b38',uuid=f8c9cca7-1c97-4af8-9c7d-c823330e507c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converting VIF {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01e0d16c-36, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5538fa1-2c9d-42e4-860a-75614eebd004) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:52 user nova-compute[74932]: INFO os_vif [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=01e0d16c-3622-40ef-9fca-d86a087d7796,network=Network(d0fb9c44-9c0b-4fa9-9754-86a9836f2b70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e0d16c-36')
Nov 03 16:32:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yziKXCoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:32:52 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:32:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf87fe8-f540-461e-8104-70d8eb0de4f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]: iSNS:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]: STATIC:
Nov 03 16:32:53 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62
Nov 03 16:32:53 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:53 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:53 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51
Nov 03 16:32:53 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:53 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:53 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88
Nov 03 16:32:53 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:53 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:53 user nova-compute[74932]: FIRMWARE:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:32:53 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:32:53 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[37feba6f-b2d0-4531-9697-5147dbadf848]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fcbec0-0b3a-489c-bfd1-645cf468e59b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6445f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20613da-d127-4470-a71e-ef03baaaf270]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[76311828-fff1-422d-aaaa-55e8d4048c06]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d342e23d-e918-40ea-8dcc-8ed8878e1dfe]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a072fda-8f0f-4b0c-b23b-c64312e09253]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4399bc74-be7d-4225-ae19-4dbf449b646b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a67e1-f645-401a-8707-853be3970f24]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260]
Nov 03 16:32:53 user nova-compute[74932]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88, portal: 172.16.0.220,3260] successful.
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4a8c616-f7d5-47a1-950e-f14740a88f88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea69a3-ed85-4784-ac08-bc9fb7e5f7a1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== disconnect_volume: return (380ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVpMwqIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:32:53 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[527c3f8e-a7ff-4767-aa8b-70a96f8f3b44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]: iSNS:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]: STATIC:
Nov 03 16:32:53 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62
Nov 03 16:32:53 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:53 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:53 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51
Nov 03 16:32:53 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:53 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:53 user nova-compute[74932]: FIRMWARE:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:32:53 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:32:53 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2540d9a-fe07-49a3-be04-81e15524e209]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf6588c-ca4d-408e-adea-423c9560af9c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8456dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1070b9-59bc-4c29-bf54-85fa5d7331c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Acquiring lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] No waiting events found dispatching network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:53 user nova-compute[74932]: WARNING nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received unexpected event network-vif-plugged-01e0d16c-3622-40ef-9fca-d86a087d7796 for instance with vm_state active and task_state deleting.
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:53 user nova-compute[74932]: WARNING nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state active and task_state rescuing.
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:32:53 user nova-compute[74932]: WARNING nova.compute.manager [req-fb7d1b29-d9d1-48f0-85fc-2f5679bba05b req-2f3f372a-bf2f-47b6-9625-1e6dc031a7a7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state active and task_state rescuing.
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc095a25-5469-4260-b79e-6152dfd98450]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d407d946-6613-4ba9-b829-8c24bdb36e7c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a06253a-e90f-4937-912c-233d51dba2fa]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ab773-c38c-4dc5-8176-75df814708d3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67fac3e-70a3-419b-a1fe-11cf2e15d6b9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260]
Nov 03 16:32:53 user nova-compute[74932]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51, portal: 172.16.0.220,3260] successful.
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31d04bc8-c7e1-4fd8-933b-c168612bcc51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1be41-46c9-4d62-a672-66bbeece2f69]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== disconnect_volume: return (417ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeJaAbON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:32:53 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af488f2-5d2d-494f-a206-26c24046e0cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]: iSNS:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]: STATIC:
Nov 03 16:32:53 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62
Nov 03 16:32:53 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:32:53 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:32:53 user nova-compute[74932]: FIRMWARE:
Nov 03 16:32:53 user nova-compute[74932]: No targets found.
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:32:53 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:32:53 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8648d9-aa99-4cfe-bd5c-b3a6bb6ecd80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de16036-ce3f-456f-accd-7c83ffe6c16d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 (non-flash)
Nov 03 16:32:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6432a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62'): ({'sde'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Removing single pathed devices sde {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7f1d12-d9df-403b-87fd-11752f2d0f60]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a1fdb-af36-4634-9334-d3acc9f0498a]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Flushing IO for device /dev/sde {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b9e4c0-bc9b-4dcf-a575-5045ceadb057]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:32:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e384cb-c4eb-4ba1-b5c0-4d0d84a2e13e]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac5d4e-8b6b-42de-a39b-4fb5bd1e6d47]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b01352-201f-43ad-ae16-94af6d1b6cd6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260]
Nov 03 16:32:54 user nova-compute[74932]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62, portal: 172.16.0.220,3260] successful.
Nov 03 16:32:54 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918b72de-ad14-4686-9ba2-0ef5387cca62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adddb11-eda7-42bc-94dc-a15b0eaa4684]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] <== disconnect_volume: return (352ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:32:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Deleting instance files /opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c_del
Nov 03 16:32:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Deletion of /opt/stack/data/nova/instances/f8c9cca7-1c97-4af8-9c7d-c823330e507c_del complete
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: INFO nova.compute.manager [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Took 4.48 seconds to destroy the instance on the hypervisor.
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c4f57792-c3e6-4f72-b6ea-aa983355e16a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:32:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:32:55 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid 'f8c9cca7-1c97-4af8-9c7d-c823330e507c' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f8c9cca7-1c97-4af8-9c7d-c823330e507c' (instance-00000010)
Nov 03 16:32:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:32:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=25.398189544677734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1b97e423-b373-4f86-8ad7-281b30af23ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e56b15a2-5641-442d-ac1a-3670f44dfd45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-1ae0ab4c-75df-44e3-8a14-977cb9c3b3b9 req-e5a812fb-22b7-4227-a1a6-3ad2d04a3c44 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-deleted-b806163e-05c2-4c65-b7c6-9bd524d51962 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:56 user nova-compute[74932]: INFO nova.compute.manager [req-1ae0ab4c-75df-44e3-8a14-977cb9c3b3b9 req-e5a812fb-22b7-4227-a1a6-3ad2d04a3c44 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Neutron deleted interface b806163e-05c2-4c65-b7c6-9bd524d51962; detaching it from the instance and deleting it from the info cache
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-1ae0ab4c-75df-44e3-8a14-977cb9c3b3b9 req-e5a812fb-22b7-4227-a1a6-3ad2d04a3c44 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da2d68a2-4bfd-494f-a06f-815126402456", "address": "fa:16:3e:ee:43:24", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda2d68a2-4b", "ovs_interfaceid": "da2d68a2-4bfd-494f-a06f-815126402456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-1ae0ab4c-75df-44e3-8a14-977cb9c3b3b9 req-e5a812fb-22b7-4227-a1a6-3ad2d04a3c44 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Detach interface failed, port_id=b806163e-05c2-4c65-b7c6-9bd524d51962, reason: Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:32:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:32:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-deleted-da2d68a2-4bfd-494f-a06f-815126402456 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:58 user nova-compute[74932]: INFO nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Neutron deleted interface da2d68a2-4bfd-494f-a06f-815126402456; detaching it from the instance and deleting it from the info cache
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f833233-310c-4d46-90f5-24b22a340ba6", "address": "fa:16:3e:27:98:1e", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833233-31", "ovs_interfaceid": "4f833233-310c-4d46-90f5-24b22a340ba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Detach interface failed, port_id=da2d68a2-4bfd-494f-a06f-815126402456, reason: Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-deleted-4f833233-310c-4d46-90f5-24b22a340ba6 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:58 user nova-compute[74932]: INFO nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Neutron deleted interface 4f833233-310c-4d46-90f5-24b22a340ba6; detaching it from the instance and deleting it from the info cache
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e0d16c-3622-40ef-9fca-d86a087d7796", "address": "fa:16:3e:e9:e0:41", "network": {"id": "d0fb9c44-9c0b-4fa9-9754-86a9836f2b70", "bridge": "br-int", "label": "tempest-device-tagging-net2-229403021", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e0d16c-36", "ovs_interfaceid": "01e0d16c-3622-40ef-9fca-d86a087d7796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Detach interface failed, port_id=4f833233-310c-4d46-90f5-24b22a340ba6, reason: Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-deleted-01e0d16c-3622-40ef-9fca-d86a087d7796 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:32:58 user nova-compute[74932]: INFO nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Neutron deleted interface 01e0d16c-3622-40ef-9fca-d86a087d7796; detaching it from the instance and deleting it from the info cache
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [{"id": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "address": "fa:16:3e:6e:1a:c4", "network": {"id": "42b46a4b-ddec-47d0-a4b0-3fe6b4043f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1515196294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abb133f-d6", "ovs_interfaceid": "1abb133f-d6e7-4993-a37b-abe7343e75b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "address": "fa:16:3e:75:e7:18", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afaedc9-d2", "ovs_interfaceid": "4afaedc9-d29c-4d64-8bfe-96b70b3ec81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4c7edf5-b485-4434-a7c3-4740df831df8", "address": "fa:16:3e:5b:27:83", "network": {"id": "70cadeea-5403-4ede-b2aa-a8d515b41bd7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638516392", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "846c49ad0b704a60b8bc3b11cdaace79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c7edf5-b4", "ovs_interfaceid": "d4c7edf5-b485-4434-a7c3-4740df831df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:32:58 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Took 4.40 seconds to deallocate network for instance.
Nov 03 16:32:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-ed743256-483c-4ebc-a150-42f90234da88 req-d297a8a9-aa04-43c7-8298-2744958cb3a6 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Detach interface failed, port_id=01e0d16c-3622-40ef-9fca-d86a087d7796, reason: Instance f8c9cca7-1c97-4af8-9c7d-c823330e507c could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:33:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f3fe3f56-4cf1-49b8-8fd1-9f59ab78bcfd req-80d39c33-25bf-4271-942a-8b5772a96851 service nova] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Received event network-vif-deleted-1abb133f-d6e7-4993-a37b-abe7343e75b0 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:01 user nova-compute[74932]: INFO nova.compute.manager [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] [instance: f8c9cca7-1c97-4af8-9c7d-c823330e507c] Took 2.68 seconds to detach 3 volumes for instance.
Nov 03 16:33:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:01 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:33:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:33:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:01 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Deleted allocations for instance f8c9cca7-1c97-4af8-9c7d-c823330e507c
Nov 03 16:33:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0915192d-c1e5-465c-b7d9-328dde9e6315 tempest-TaggedBootDevicesTest_v242-2142622839 tempest-TaggedBootDevicesTest_v242-2142622839-project-member] Lock "f8c9cca7-1c97-4af8-9c7d-c823330e507c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.051s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-changed-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Refreshing instance network info cache due to event network-changed-0c575c5b-4834-49fc-85bc-19b531842c25. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Refreshing network info cache for port 0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updated VIF entry in instance network info cache for port 0c575c5b-4834-49fc-85bc-19b531842c25. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:33:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-25113c07-ae0a-46fb-9e62-f9a6ae9e0cb7 req-e0a2bc25-2329-4777-b3c2-5b813e78a77a service nova] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:33:14 user nova-compute[74932]: INFO nova.compute.manager [None req-06670f29-33cb-4761-b34e-ceef87a168c1 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Get console output
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Events pending at deletion: volume-reimaged-cf741834-ac61-45fe-aeb4-a9251302df16 {{(pid=74932) _delete_instance /opt/stack/nova/nova/compute/manager.py:3257}}
Nov 03 16:33:14 user nova-compute[74932]: INFO nova.compute.manager [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Terminating instance
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] During wait destroy, instance disappeared. {{(pid=74932) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 03 16:33:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Instance destroyed successfully.
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lazy-loading 'resources' on Instance uuid 391f8ba7-9f07-474e-b606-1abb8c9b3dee {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:24:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-127648816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-935812280',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwiX0Eer8boPtkeg21Q3WVjGPrtuRI87BvCPwg/zTo9q9fQ6IznvXpyEk/YqgUUcVrL1cdDE+llEXNeaiBRClyHO4gLj84yQoWRaEl9cwuUIeZOc9/GqxqlMqa4hJoIcg==',key_name='tempest-keypair-2026465143',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='7e884e8ac4b047bea339b595cafc9866',ramdisk_id='',reservation_id='r-zru35iyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2099233701',owner_user_name='tempest-ServerActionsV293TestJSON-2099233701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc63611e05044d5f9f3abfec22d64fb4',uuid=391f8ba7-9f07-474e-b606-1abb8c9b3dee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converting VIF {"id": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "address": "fa:16:3e:5e:d8:71", "network": {"id": "61fe40dd-8197-454f-95be-abaad29a0b61", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-562157424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e884e8ac4b047bea339b595cafc9866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ba1a967-90", "ovs_interfaceid": "8ba1a967-902e-48f5-b5df-96b0fef4b8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_vif [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ba1a967-90, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:33:14 user nova-compute[74932]: INFO os_vif [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d8:71,bridge_name='br-int',has_traffic_filtering=True,id=8ba1a967-902e-48f5-b5df-96b0fef4b8fd,network=Network(61fe40dd-8197-454f-95be-abaad29a0b61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ba1a967-90')
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf741834-ac61-45fe-aeb4-a9251302df16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFuSHkgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:33:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[998483c3-4ca7-45f9-9851-393c9dc3b661]: Unexpected error while running command.
Nov 03 16:33:14 user nova-compute[74932]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 16:33:14 user nova-compute[74932]: Exit code: 21
Nov 03 16:33:14 user nova-compute[74932]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 16:33:14 user nova-compute[74932]: Stderr: '' {{(pid=85951) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 03 16:33:14 user nova-compute[74932]: Traceback (most recent call last):
Nov 03 16:33:14 user nova-compute[74932]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 03 16:33:14 user nova-compute[74932]:     ret = func(*f_args, **f_kwargs)
Nov 03 16:33:14 user nova-compute[74932]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 03 16:33:14 user nova-compute[74932]:     return func(*args, **kwargs)
Nov 03 16:33:14 user nova-compute[74932]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 03 16:33:14 user nova-compute[74932]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 03 16:33:14 user nova-compute[74932]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 03 16:33:14 user nova-compute[74932]:     return putils.execute(on_execute=on_execute,
Nov 03 16:33:14 user nova-compute[74932]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 03 16:33:14 user nova-compute[74932]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 03 16:33:14 user nova-compute[74932]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 03 16:33:14 user nova-compute[74932]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 16:33:14 user nova-compute[74932]: Exit code: 21
Nov 03 16:33:14 user nova-compute[74932]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 16:33:14 user nova-compute[74932]: Stderr: ''
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[998483c3-4ca7-45f9-9851-393c9dc3b661]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 03 16:33:14 user nova-compute[74932]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 16:33:14 user nova-compute[74932]: Exit code: 21
Nov 03 16:33:14 user nova-compute[74932]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 16:33:14 user nova-compute[74932]: Stderr: ''
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 03 16:33:14 user nova-compute[74932]: ERROR os_brick.initiator.connectors.iscsi 
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74932) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] <== disconnect_volume: return (34ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:33:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Deletion of /opt/stack/data/nova/instances/391f8ba7-9f07-474e-b606-1abb8c9b3dee_del complete
Nov 03 16:33:14 user nova-compute[74932]: INFO nova.compute.manager [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Took 0.14 seconds to destroy the instance on the hypervisor.
Nov 03 16:33:14 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:33:14 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:33:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:15 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:15 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Took 1.09 seconds to deallocate network for instance.
Nov 03 16:33:15 user nova-compute[74932]: INFO nova.compute.manager [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Took 0.09 seconds to detach 1 volumes for instance.
Nov 03 16:33:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Deleting volume: cf741834-ac61-45fe-aeb4-a9251302df16 {{(pid=74932) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 16:33:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-6d7139ec-9baa-4925-a1da-a2e2b75dc526 req-edbcf09c-e5d2-4073-b7a2-bcd44f9e72fc service nova] [instance: 391f8ba7-9f07-474e-b606-1abb8c9b3dee] Received event network-vif-deleted-8ba1a967-902e-48f5-b5df-96b0fef4b8fd {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:16 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:33:16 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:33:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:16 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Deleted allocations for instance 391f8ba7-9f07-474e-b606-1abb8c9b3dee
Nov 03 16:33:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2acf902a-e593-4fb7-9841-dc2efa809c93 tempest-ServerActionsV293TestJSON-2099233701 tempest-ServerActionsV293TestJSON-2099233701-project-member] Lock "391f8ba7-9f07-474e-b606-1abb8c9b3dee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.914s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "e72d836e-bb58-4a3a-95e2-116255664468" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:33:22 user nova-compute[74932]: INFO nova.compute.claims [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Claim successful on node user
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:33:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.policy [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55c678331ab147d8970f06830f55853b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660be27a2adc4e15b5585a9d90bb5d8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:33:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Creating image(s)
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "/opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "/opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "/opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk 1073741824" returned: 0 in 0.053s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Successfully created port: 830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.211s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Cannot resize image /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Ensure instance console log exists: /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:23 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:33:23 user nova-compute[74932]: INFO nova.compute.claims [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Claim successful on node user
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Successfully updated port: 830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "refresh_cache-e72d836e-bb58-4a3a-95e2-116255664468" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquired lock "refresh_cache-e72d836e-bb58-4a3a-95e2-116255664468" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-changed-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Refreshing instance network info cache due to event network-changed-830ed123-a619-4228-85ac-b21dd0279735. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] Acquiring lock "refresh_cache-e72d836e-bb58-4a3a-95e2-116255664468" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:33:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.policy [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99403819bf9845ac85cf9ff73a492507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c887cbc267d40dd9e270a25f6baf66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:33:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Creating image(s)
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "/opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "/opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Updating instance_info_cache with network_info: [{"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Releasing lock "refresh_cache-e72d836e-bb58-4a3a-95e2-116255664468" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Instance network_info: |[{"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] Acquired lock "refresh_cache-e72d836e-bb58-4a3a-95e2-116255664468" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Refreshing network info cache for port 830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Start _get_guest_xml network_info=[{"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:33:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:33:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-344167236',display_name='tempest-VolumesActionsTest-instance-344167236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-344167236',id=22,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='660be27a2adc4e15b5585a9d90bb5d8a',ramdisk_id='',reservation_id='r-crk3tot7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-453500561',owner_user_name='tempest-VolumesActionsTest-453500561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:33:23Z,user_data=None,user_id='55c678331ab147d8970f06830f55853b',uuid=e72d836e-bb58-4a3a-95e2-116255664468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converting VIF {"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.objects.instance [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lazy-loading 'pci_devices' on Instance uuid e72d836e-bb58-4a3a-95e2-116255664468 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.227s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:33:24 user nova-compute[74932]:   <uuid>e72d836e-bb58-4a3a-95e2-116255664468</uuid>
Nov 03 16:33:24 user nova-compute[74932]:   <name>instance-00000016</name>
Nov 03 16:33:24 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:33:24 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:33:24 user nova-compute[74932]:   <metadata>
Nov 03 16:33:24 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:33:24 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:33:24 user nova-compute[74932]:       <nova:name>tempest-VolumesActionsTest-instance-344167236</nova:name>
Nov 03 16:33:24 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:33:24</nova:creationTime>
Nov 03 16:33:24 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:33:24 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:33:24 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:33:24 user nova-compute[74932]:       <nova:owner>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:user uuid="55c678331ab147d8970f06830f55853b">tempest-VolumesActionsTest-453500561-project-member</nova:user>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:project uuid="660be27a2adc4e15b5585a9d90bb5d8a">tempest-VolumesActionsTest-453500561</nova:project>
Nov 03 16:33:24 user nova-compute[74932]:       </nova:owner>
Nov 03 16:33:24 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:33:24 user nova-compute[74932]:       <nova:ports>
Nov 03 16:33:24 user nova-compute[74932]:         <nova:port uuid="830ed123-a619-4228-85ac-b21dd0279735">
Nov 03 16:33:24 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 16:33:24 user nova-compute[74932]:         </nova:port>
Nov 03 16:33:24 user nova-compute[74932]:       </nova:ports>
Nov 03 16:33:24 user nova-compute[74932]:     </nova:instance>
Nov 03 16:33:24 user nova-compute[74932]:   </metadata>
Nov 03 16:33:24 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:33:24 user nova-compute[74932]:     <system>
Nov 03 16:33:24 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:33:24 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:33:24 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:33:24 user nova-compute[74932]:       <entry name="serial">e72d836e-bb58-4a3a-95e2-116255664468</entry>
Nov 03 16:33:24 user nova-compute[74932]:       <entry name="uuid">e72d836e-bb58-4a3a-95e2-116255664468</entry>
Nov 03 16:33:24 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:33:24 user nova-compute[74932]:     </system>
Nov 03 16:33:24 user nova-compute[74932]:   </sysinfo>
Nov 03 16:33:24 user nova-compute[74932]:   <os>
Nov 03 16:33:24 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:33:24 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:33:24 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:33:24 user nova-compute[74932]:   </os>
Nov 03 16:33:24 user nova-compute[74932]:   <features>
Nov 03 16:33:24 user nova-compute[74932]:     <acpi/>
Nov 03 16:33:24 user nova-compute[74932]:     <apic/>
Nov 03 16:33:24 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:33:24 user nova-compute[74932]:   </features>
Nov 03 16:33:24 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:33:24 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:33:24 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:33:24 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:33:24 user nova-compute[74932]:   </clock>
Nov 03 16:33:24 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:33:24 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:33:24 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:33:24 user nova-compute[74932]:   </cpu>
Nov 03 16:33:24 user nova-compute[74932]:   <devices>
Nov 03 16:33:24 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:33:24 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:33:24 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk"/>
Nov 03 16:33:24 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:33:24 user nova-compute[74932]:     </disk>
Nov 03 16:33:24 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:33:24 user nova-compute[74932]:       <mac address="fa:16:3e:66:d3:c8"/>
Nov 03 16:33:24 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:33:24 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:33:24 user nova-compute[74932]:       <target dev="tap830ed123-a6"/>
Nov 03 16:33:24 user nova-compute[74932]:     </interface>
Nov 03 16:33:24 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:33:24 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/console.log" append="off"/>
Nov 03 16:33:24 user nova-compute[74932]:     </serial>
Nov 03 16:33:24 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:33:24 user nova-compute[74932]:     <video>
Nov 03 16:33:24 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:33:24 user nova-compute[74932]:     </video>
Nov 03 16:33:24 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:33:24 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:33:24 user nova-compute[74932]:     </rng>
Nov 03 16:33:24 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:33:24 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:33:24 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:33:24 user nova-compute[74932]:     </memballoon>
Nov 03 16:33:24 user nova-compute[74932]:   </devices>
Nov 03 16:33:24 user nova-compute[74932]: </domain>
Nov 03 16:33:24 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-344167236',display_name='tempest-VolumesActionsTest-instance-344167236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-344167236',id=22,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='660be27a2adc4e15b5585a9d90bb5d8a',ramdisk_id='',reservation_id='r-crk3tot7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-453500561',owner_user_name='tempest-VolumesActionsTest-453500561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:33:23Z,user_data=None,user_id='55c678331ab147d8970f06830f55853b',uuid=e72d836e-bb58-4a3a-95e2-116255664468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converting VIF {"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG os_vif [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd36e509e-78b4-57d5-be0e-9031544d0b7f', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap830ed123-a6, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap830ed123-a6, col_values=(('qos', UUID('05ad4a84-5f2b-402b-b4b7-ee9b62878695')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap830ed123-a6, col_values=(('external_ids', {'iface-id': '830ed123-a619-4228-85ac-b21dd0279735', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:d3:c8', 'vm-uuid': 'e72d836e-bb58-4a3a-95e2-116255664468'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:24 user nova-compute[74932]: INFO os_vif [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6')
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] No VIF found with MAC fa:16:3e:66:d3:c8, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.222s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk 1073741824" returned: 0 in 0.066s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Successfully created port: 032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Updated VIF entry in instance network info cache for port 830ed123-a619-4228-85ac-b21dd0279735. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Updating instance_info_cache with network_info: [{"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8fc56a1b-2b20-454b-bd0f-61c53251d5e9 req-71e6c57e-2ed5-47d5-b889-9e0417c997cd service nova] Releasing lock "refresh_cache-e72d836e-bb58-4a3a-95e2-116255664468" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Cannot resize image /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Ensure instance console log exists: /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Successfully updated port: 032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquired lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-changed-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Refreshing instance network info cache due to event network-changed-032a623c-ee7b-4830-8652-1c825c7f9bbb. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] Acquiring lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating instance_info_cache with network_info: [{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Releasing lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Instance network_info: |[{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] Acquired lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Refreshing network info cache for port 032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Start _get_guest_xml network_info=[{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:33:25 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:33:25 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-493201516',display_name='tempest-TestStampPattern-server-493201516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-493201516',id=23,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMj9AIFIKO0NgK0zkHn0Jy+l3mgfcxgiBUpQw/9Yol77VWUT8u3eYfCI0rb+RgkX7v+WG5SHkNUka8piM/z+1zFyCPRyze8JQydhtJPBVujfoF47Ahsa+Vb6gz5xkxMaw==',key_name='tempest-TestStampPattern-1337686481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c887cbc267d40dd9e270a25f6baf66f',ramdisk_id='',reservation_id='r-tnhs7060',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606523677',owner_user_name='tempest-TestStampPattern-1606523677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:33:24Z,user_data=None,user_id='99403819bf9845ac85cf9ff73a492507',uuid=ad86cdd7-1253-4246-ac62-32c4898b30df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converting VIF {"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:33:25 user nova-compute[74932]: DEBUG nova.objects.instance [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'pci_devices' on Instance uuid ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:33:26 user nova-compute[74932]:   <uuid>ad86cdd7-1253-4246-ac62-32c4898b30df</uuid>
Nov 03 16:33:26 user nova-compute[74932]:   <name>instance-00000017</name>
Nov 03 16:33:26 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:33:26 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:33:26 user nova-compute[74932]:   <metadata>
Nov 03 16:33:26 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:33:26 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:33:26 user nova-compute[74932]:       <nova:name>tempest-TestStampPattern-server-493201516</nova:name>
Nov 03 16:33:26 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:33:25</nova:creationTime>
Nov 03 16:33:26 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:33:26 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:33:26 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:33:26 user nova-compute[74932]:       <nova:owner>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:user uuid="99403819bf9845ac85cf9ff73a492507">tempest-TestStampPattern-1606523677-project-member</nova:user>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:project uuid="2c887cbc267d40dd9e270a25f6baf66f">tempest-TestStampPattern-1606523677</nova:project>
Nov 03 16:33:26 user nova-compute[74932]:       </nova:owner>
Nov 03 16:33:26 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:33:26 user nova-compute[74932]:       <nova:ports>
Nov 03 16:33:26 user nova-compute[74932]:         <nova:port uuid="032a623c-ee7b-4830-8652-1c825c7f9bbb">
Nov 03 16:33:26 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:33:26 user nova-compute[74932]:         </nova:port>
Nov 03 16:33:26 user nova-compute[74932]:       </nova:ports>
Nov 03 16:33:26 user nova-compute[74932]:     </nova:instance>
Nov 03 16:33:26 user nova-compute[74932]:   </metadata>
Nov 03 16:33:26 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:33:26 user nova-compute[74932]:     <system>
Nov 03 16:33:26 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:33:26 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:33:26 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:33:26 user nova-compute[74932]:       <entry name="serial">ad86cdd7-1253-4246-ac62-32c4898b30df</entry>
Nov 03 16:33:26 user nova-compute[74932]:       <entry name="uuid">ad86cdd7-1253-4246-ac62-32c4898b30df</entry>
Nov 03 16:33:26 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:33:26 user nova-compute[74932]:     </system>
Nov 03 16:33:26 user nova-compute[74932]:   </sysinfo>
Nov 03 16:33:26 user nova-compute[74932]:   <os>
Nov 03 16:33:26 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:33:26 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:33:26 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:33:26 user nova-compute[74932]:   </os>
Nov 03 16:33:26 user nova-compute[74932]:   <features>
Nov 03 16:33:26 user nova-compute[74932]:     <acpi/>
Nov 03 16:33:26 user nova-compute[74932]:     <apic/>
Nov 03 16:33:26 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:33:26 user nova-compute[74932]:   </features>
Nov 03 16:33:26 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:33:26 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:33:26 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:33:26 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:33:26 user nova-compute[74932]:   </clock>
Nov 03 16:33:26 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:33:26 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:33:26 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:33:26 user nova-compute[74932]:   </cpu>
Nov 03 16:33:26 user nova-compute[74932]:   <devices>
Nov 03 16:33:26 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:33:26 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:33:26 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk"/>
Nov 03 16:33:26 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:33:26 user nova-compute[74932]:     </disk>
Nov 03 16:33:26 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:33:26 user nova-compute[74932]:       <mac address="fa:16:3e:af:a5:76"/>
Nov 03 16:33:26 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:33:26 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:33:26 user nova-compute[74932]:       <target dev="tap032a623c-ee"/>
Nov 03 16:33:26 user nova-compute[74932]:     </interface>
Nov 03 16:33:26 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:33:26 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/console.log" append="off"/>
Nov 03 16:33:26 user nova-compute[74932]:     </serial>
Nov 03 16:33:26 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:33:26 user nova-compute[74932]:     <video>
Nov 03 16:33:26 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:33:26 user nova-compute[74932]:     </video>
Nov 03 16:33:26 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:33:26 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:33:26 user nova-compute[74932]:     </rng>
Nov 03 16:33:26 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:33:26 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:33:26 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:33:26 user nova-compute[74932]:     </memballoon>
Nov 03 16:33:26 user nova-compute[74932]:   </devices>
Nov 03 16:33:26 user nova-compute[74932]: </domain>
Nov 03 16:33:26 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-493201516',display_name='tempest-TestStampPattern-server-493201516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-493201516',id=23,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMj9AIFIKO0NgK0zkHn0Jy+l3mgfcxgiBUpQw/9Yol77VWUT8u3eYfCI0rb+RgkX7v+WG5SHkNUka8piM/z+1zFyCPRyze8JQydhtJPBVujfoF47Ahsa+Vb6gz5xkxMaw==',key_name='tempest-TestStampPattern-1337686481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c887cbc267d40dd9e270a25f6baf66f',ramdisk_id='',reservation_id='r-tnhs7060',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606523677',owner_user_name='tempest-TestStampPattern-1606523677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:33:24Z,user_data=None,user_id='99403819bf9845ac85cf9ff73a492507',uuid=ad86cdd7-1253-4246-ac62-32c4898b30df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converting VIF {"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG os_vif [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7116422e-192f-531c-beb6-71ad16eff38c', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap032a623c-ee, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap032a623c-ee, col_values=(('qos', UUID('5414fff1-21dc-42fa-9095-d93fa9c4b549')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap032a623c-ee, col_values=(('external_ids', {'iface-id': '032a623c-ee7b-4830-8652-1c825c7f9bbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:a5:76', 'vm-uuid': 'ad86cdd7-1253-4246-ac62-32c4898b30df'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: INFO os_vif [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee')
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No VIF found with MAC fa:16:3e:af:a5:76, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.network.neutron [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updated VIF entry in instance network info cache for port 032a623c-ee7b-4830-8652-1c825c7f9bbb. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG nova.network.neutron [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating instance_info_cache with network_info: [{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-30599441-8bdb-4f2a-9e52-dad1289061ce req-cd8efcfb-f993-4efa-aec1-f8baf9c43eb5 service nova] Releasing lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] No waiting events found dispatching network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:33:27 user nova-compute[74932]: WARNING nova.compute.manager [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received unexpected event network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 for instance with vm_state building and task_state spawning.
Nov 03 16:33:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] No waiting events found dispatching network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:33:27 user nova-compute[74932]: WARNING nova.compute.manager [req-9c1fa900-d6a2-4406-bfc0-d598cdbf425c req-4eaeeb2a-5955-44ed-a3af-8b5d1308b64b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received unexpected event network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 for instance with vm_state building and task_state spawning.
Nov 03 16:33:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-b7826ad1-3f4d-4b8b-b6bd-95036e100635 req-5797270a-9382-43dd-bd16-a23459624690 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b7826ad1-3f4d-4b8b-b6bd-95036e100635 req-5797270a-9382-43dd-bd16-a23459624690 service nova] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b7826ad1-3f4d-4b8b-b6bd-95036e100635 req-5797270a-9382-43dd-bd16-a23459624690 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b7826ad1-3f4d-4b8b-b6bd-95036e100635 req-5797270a-9382-43dd-bd16-a23459624690 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-b7826ad1-3f4d-4b8b-b6bd-95036e100635 req-5797270a-9382-43dd-bd16-a23459624690 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] No waiting events found dispatching network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:33:27 user nova-compute[74932]: WARNING nova.compute.manager [req-b7826ad1-3f4d-4b8b-b6bd-95036e100635 req-5797270a-9382-43dd-bd16-a23459624690 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received unexpected event network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb for instance with vm_state building and task_state spawning.
Nov 03 16:33:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:33:29 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Instance spawned successfully.
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: INFO nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:33:29 user nova-compute[74932]: INFO nova.compute.manager [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Took 7.51 seconds to build instance.
Nov 03 16:33:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-749a4056-c889-4753-892e-0ff0c133e90e tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "e72d836e-bb58-4a3a-95e2-116255664468" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.616s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:33:29 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Instance spawned successfully.
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:33:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-9bd9980a-b708-404a-ad0b-bb521f03f534 req-6676ca51-8e2e-4e02-a405-8a105e91d715 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9bd9980a-b708-404a-ad0b-bb521f03f534 req-6676ca51-8e2e-4e02-a405-8a105e91d715 service nova] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9bd9980a-b708-404a-ad0b-bb521f03f534 req-6676ca51-8e2e-4e02-a405-8a105e91d715 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9bd9980a-b708-404a-ad0b-bb521f03f534 req-6676ca51-8e2e-4e02-a405-8a105e91d715 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-9bd9980a-b708-404a-ad0b-bb521f03f534 req-6676ca51-8e2e-4e02-a405-8a105e91d715 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] No waiting events found dispatching network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:33:30 user nova-compute[74932]: WARNING nova.compute.manager [req-9bd9980a-b708-404a-ad0b-bb521f03f534 req-6676ca51-8e2e-4e02-a405-8a105e91d715 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received unexpected event network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb for instance with vm_state building and task_state spawning.
Nov 03 16:33:30 user nova-compute[74932]: INFO nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 03 16:33:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:33:30 user nova-compute[74932]: INFO nova.compute.manager [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Took 6.47 seconds to build instance.
Nov 03 16:33:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8ee1fdac-6ea5-465c-be9e-6b5a8ea2a965 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.591s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:35 user nova-compute[74932]: INFO nova.compute.manager [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Terminating instance
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-adfe71b7-58b8-4e06-b310-b6d9166dc99c req-82693578-4f8e-4c1e-9acd-ef0e104af582 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-vif-unplugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-adfe71b7-58b8-4e06-b310-b6d9166dc99c req-82693578-4f8e-4c1e-9acd-ef0e104af582 service nova] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-adfe71b7-58b8-4e06-b310-b6d9166dc99c req-82693578-4f8e-4c1e-9acd-ef0e104af582 service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-adfe71b7-58b8-4e06-b310-b6d9166dc99c req-82693578-4f8e-4c1e-9acd-ef0e104af582 service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-adfe71b7-58b8-4e06-b310-b6d9166dc99c req-82693578-4f8e-4c1e-9acd-ef0e104af582 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] No waiting events found dispatching network-vif-unplugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-adfe71b7-58b8-4e06-b310-b6d9166dc99c req-82693578-4f8e-4c1e-9acd-ef0e104af582 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-vif-unplugged-960126c0-deac-4948-89c7-c42defe84a9f for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:33:35 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Instance destroyed successfully.
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.objects.instance [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'resources' on Instance uuid 1b97e423-b373-4f86-8ad7-281b30af23ee {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-833970234',display_name='tempest-AttachVolumeNegativeTest-server-833970234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-833970234',id=15,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN5HQr7IR3KoR0UMaY4JH8gSzVpM4Oz2MT5EQAsUgnlTxka4LruIJ0akweVncgxfp31dvfrbXVLD+CD6913AzVIpDzQ9Osf4p7q2oquI8jekzNNEryfMrujvTsR+VF8mQ==',key_name='tempest-keypair-1858235203',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:28:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-95jme9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=1b97e423-b373-4f86-8ad7-281b30af23ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "960126c0-deac-4948-89c7-c42defe84a9f", "address": "fa:16:3e:88:4c:5b", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap960126c0-de", "ovs_interfaceid": "960126c0-deac-4948-89c7-c42defe84a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG os_vif [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap960126c0-de, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c045ca4f-182d-4c5a-b2a5-8f07d8ed30b4) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:36 user nova-compute[74932]: INFO os_vif [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:4c:5b,bridge_name='br-int',has_traffic_filtering=True,id=960126c0-deac-4948-89c7-c42defe84a9f,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap960126c0-de')
Nov 03 16:33:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Deleting instance files /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee_del
Nov 03 16:33:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Deletion of /opt/stack/data/nova/instances/1b97e423-b373-4f86-8ad7-281b30af23ee_del complete
Nov 03 16:33:36 user nova-compute[74932]: INFO nova.compute.manager [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 03 16:33:36 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-ba1da322-d833-42ff-bd1d-6231c2f5d733 req-e214fca2-f72e-4bc5-af2f-ef243b7f6af7 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-vif-deleted-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:36 user nova-compute[74932]: INFO nova.compute.manager [req-ba1da322-d833-42ff-bd1d-6231c2f5d733 req-e214fca2-f72e-4bc5-af2f-ef243b7f6af7 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Neutron deleted interface 960126c0-deac-4948-89c7-c42defe84a9f; detaching it from the instance and deleting it from the info cache
Nov 03 16:33:36 user nova-compute[74932]: DEBUG nova.network.neutron [req-ba1da322-d833-42ff-bd1d-6231c2f5d733 req-e214fca2-f72e-4bc5-af2f-ef243b7f6af7 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:36 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Took 0.82 seconds to deallocate network for instance.
Nov 03 16:33:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-ba1da322-d833-42ff-bd1d-6231c2f5d733 req-e214fca2-f72e-4bc5-af2f-ef243b7f6af7 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Detach interface failed, port_id=960126c0-deac-4948-89c7-c42defe84a9f, reason: Instance 1b97e423-b373-4f86-8ad7-281b30af23ee could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:37 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Deleted allocations for instance 1b97e423-b373-4f86-8ad7-281b30af23ee
Nov 03 16:33:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-d03bc366-df72-4eb4-9d18-8a264eeb5aea req-df79addc-3759-4a85-bfe0-34bd74914b35 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received event network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d03bc366-df72-4eb4-9d18-8a264eeb5aea req-df79addc-3759-4a85-bfe0-34bd74914b35 service nova] Acquiring lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d03bc366-df72-4eb4-9d18-8a264eeb5aea req-df79addc-3759-4a85-bfe0-34bd74914b35 service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d03bc366-df72-4eb4-9d18-8a264eeb5aea req-df79addc-3759-4a85-bfe0-34bd74914b35 service nova] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-d03bc366-df72-4eb4-9d18-8a264eeb5aea req-df79addc-3759-4a85-bfe0-34bd74914b35 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] No waiting events found dispatching network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:33:37 user nova-compute[74932]: WARNING nova.compute.manager [req-d03bc366-df72-4eb4-9d18-8a264eeb5aea req-df79addc-3759-4a85-bfe0-34bd74914b35 service nova] [instance: 1b97e423-b373-4f86-8ad7-281b30af23ee] Received unexpected event network-vif-plugged-960126c0-deac-4948-89c7-c42defe84a9f for instance with vm_state deleted and task_state None.
Nov 03 16:33:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-6f0fc06a-7d7c-4219-b13b-f79b64189650 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1b97e423-b373-4f86-8ad7-281b30af23ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:33:44 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:33:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 03 16:33:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:33:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:33:44 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:33:45 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:33:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:33:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:33:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lazy-loading 'flavor' on Instance uuid e56b15a2-5641-442d-ac1a-3670f44dfd45 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:50 user nova-compute[74932]: INFO nova.compute.manager [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Attaching volume d465c085-8725-44a0-bd9d-3cad516a6949 to /dev/vdb
Nov 03 16:33:50 user nova-compute[74932]: DEBUG os_brick.utils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f21c0-4075-4d5d-b079-cfcabe5a6559]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4786074-bc89-42cf-8c08-c999337d98af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[33de7176-8ec6-4ee8-92e9-127bbf5bc00d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c32be-013d-416c-8802-43c6ffbf255a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:33:50 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffd0c86-4fa3-4250-9dab-3a8b1d823ad3]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG os_brick.utils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Updating existing volume attachment record: d0ee8b48-0114-4ee5-a1a1-f5273a62c9c6 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:33:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:51 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:33:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:33:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:33:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7805MB free_disk=25.34809112548828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e56b15a2-5641-442d-ac1a-3670f44dfd45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e72d836e-bb58-4a3a-95e2-116255664468 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:33:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:33:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJBdGmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:34:10 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:34:10 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:34:10 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e5c4b8-b2e9-4ad6-a2bd-b638d9222472]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:34:10 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf1b08f-ce48-48a3-8c99-eb3d3b8b84df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949] added
Nov 03 16:34:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ff1e3-f0bf-4239-aef6-c71a47720db3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e398a51-f2c1-41ad-97a1-b37b718f0d27]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csJBdGmk {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csJBdGmk" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7714dbe5-76d2-48bf-a2e1-cbf48aa71171]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'csJBdGmk'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cdbf80-10af-46ab-89d6-5effc7efb1d2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b5c31-faf2-4636-8947-95957a630739]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:34:10 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:34:10 user nova-compute[74932]:  {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:34:10 user nova-compute[74932]: WARNING os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 16:34:10 user nova-compute[74932]: 
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c35543-ae95-4797-9079-499e100d310f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260]
Nov 03 16:34:10 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260] successful.
Nov 03 16:34:10 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.123s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03166a-a094-4404-b624-a484533ee9de]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d575bad-8593-4829-a81c-1d67e1da9d81]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 (non-flash)
Nov 03 16:34:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 (non-flash)
Nov 03 16:34:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[05924f96-2668-4329-adc8-516e067dcb3e]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:34:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJBdGmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23263323731326165', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263323731326165', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lazy-loading 'flavor' on Instance uuid e56b15a2-5641-442d-ac1a-3670f44dfd45 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:34:12 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:34:12 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:34:12 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:34:12 user nova-compute[74932]:   <serial>d465c085-8725-44a0-bd9d-3cad516a6949</serial>
Nov 03 16:34:12 user nova-compute[74932]: </disk>
Nov 03 16:34:12 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] No VIF found with MAC fa:16:3e:12:3d:76, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:34:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2957dac2-dcdb-463c-9bc9-92492df5735f tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.503s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:13 user nova-compute[74932]: INFO nova.compute.manager [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Terminating instance
Nov 03 16:34:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-a1265e46-cd24-4496-bb60-7105a931a98b req-e84a5d5e-9135-4b24-8379-b6b3fb077d90 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-vif-unplugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a1265e46-cd24-4496-bb60-7105a931a98b req-e84a5d5e-9135-4b24-8379-b6b3fb077d90 service nova] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a1265e46-cd24-4496-bb60-7105a931a98b req-e84a5d5e-9135-4b24-8379-b6b3fb077d90 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a1265e46-cd24-4496-bb60-7105a931a98b req-e84a5d5e-9135-4b24-8379-b6b3fb077d90 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-a1265e46-cd24-4496-bb60-7105a931a98b req-e84a5d5e-9135-4b24-8379-b6b3fb077d90 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] No waiting events found dispatching network-vif-unplugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-a1265e46-cd24-4496-bb60-7105a931a98b req-e84a5d5e-9135-4b24-8379-b6b3fb077d90 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-vif-unplugged-241269a6-fe50-4995-b617-550c772a2b85 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Instance destroyed successfully.
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.objects.instance [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lazy-loading 'resources' on Instance uuid e56b15a2-5641-442d-ac1a-3670f44dfd45 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-75489420',display_name='tempest-DeleteServersTestJSON-server-75489420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-75489420',id=21,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:32:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2eba13b452ca4bd7ab3950b3989efbda',ramdisk_id='',reservation_id='r-jg7l73ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1056720046',owner_user_name='tempest-DeleteServersTestJSON-1056720046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:32:01Z,user_data=None,user_id='b38a6d5ffa86469f96fc1a5f5b920f25',uuid=e56b15a2-5641-442d-ac1a-3670f44dfd45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Converting VIF {"id": "241269a6-fe50-4995-b617-550c772a2b85", "address": "fa:16:3e:12:3d:76", "network": {"id": "1f156f33-d14b-4dc0-b828-bbc3877a5f43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556295377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2eba13b452ca4bd7ab3950b3989efbda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241269a6-fe", "ovs_interfaceid": "241269a6-fe50-4995-b617-550c772a2b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_vif [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap241269a6-fe, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db289610-a3f0-4574-a535-ee8ed67c8e92) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:14 user nova-compute[74932]: INFO os_vif [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3d:76,bridge_name='br-int',has_traffic_filtering=True,id=241269a6-fe50-4995-b617-550c772a2b85,network=Network(1f156f33-d14b-4dc0-b828-bbc3877a5f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241269a6-fe')
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJBdGmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:34:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce5fd7d-20dc-4ce0-a9e1-84311ab403b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:34:14 user nova-compute[74932]: No targets found.
Nov 03 16:34:14 user nova-compute[74932]: iSNS:
Nov 03 16:34:14 user nova-compute[74932]: No targets found.
Nov 03 16:34:14 user nova-compute[74932]: STATIC:
Nov 03 16:34:14 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949
Nov 03 16:34:14 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:34:14 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:34:14 user nova-compute[74932]: FIRMWARE:
Nov 03 16:34:14 user nova-compute[74932]: No targets found.
Nov 03 16:34:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:34:14 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:34:14 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ffea63-0af2-46fb-9f79-d119172d3c65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4881e04-3efe-4533-9ee4-52afa90e5198]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 (non-flash)
Nov 03 16:34:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 (non-flash)
Nov 03 16:34:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64251990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5057942-d175-419c-8a2e-4465e82e14d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac32b5a-09c6-4200-993c-f9f7703758a8]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[257619e9-2bee-4c96-ba91-a760429cc35c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6778b0b6-fc50-47ba-a685-35f22b328365]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c6e3d1-6780-424b-83fa-6b334ac72d14]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd518e-bbfa-4875-b90b-49e496934c4b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260]
Nov 03 16:34:14 user nova-compute[74932]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949, portal: 172.16.0.220,3260] successful.
Nov 03 16:34:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d465c085-8725-44a0-bd9d-3cad516a6949 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4636d77-520a-458e-958e-70f7cf6bcb44]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] <== disconnect_volume: return (330ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:34:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Deleting instance files /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45_del
Nov 03 16:34:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Deletion of /opt/stack/data/nova/instances/e56b15a2-5641-442d-ac1a-3670f44dfd45_del complete
Nov 03 16:34:14 user nova-compute[74932]: INFO nova.compute.manager [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 03 16:34:14 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:34:14 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:34:15 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:15 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Took 0.55 seconds to deallocate network for instance.
Nov 03 16:34:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-2e74bd7f-6690-4783-90c8-ab0b3cb8a470 req-a6ca7740-b981-49be-b71c-5ce4c08bbc07 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-vif-deleted-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-1a237e57-f3bb-4ad0-a2f7-33a8863e96ac req-0e36520b-0007-4976-84af-92f3e4905f33 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received event network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1a237e57-f3bb-4ad0-a2f7-33a8863e96ac req-0e36520b-0007-4976-84af-92f3e4905f33 service nova] Acquiring lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1a237e57-f3bb-4ad0-a2f7-33a8863e96ac req-0e36520b-0007-4976-84af-92f3e4905f33 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1a237e57-f3bb-4ad0-a2f7-33a8863e96ac req-0e36520b-0007-4976-84af-92f3e4905f33 service nova] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-1a237e57-f3bb-4ad0-a2f7-33a8863e96ac req-0e36520b-0007-4976-84af-92f3e4905f33 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] No waiting events found dispatching network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:15 user nova-compute[74932]: WARNING nova.compute.manager [req-1a237e57-f3bb-4ad0-a2f7-33a8863e96ac req-0e36520b-0007-4976-84af-92f3e4905f33 service nova] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Received unexpected event network-vif-plugged-241269a6-fe50-4995-b617-550c772a2b85 for instance with vm_state active and task_state deleting.
Nov 03 16:34:16 user nova-compute[74932]: INFO nova.compute.manager [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] [instance: e56b15a2-5641-442d-ac1a-3670f44dfd45] Took 0.94 seconds to detach 1 volumes for instance.
Nov 03 16:34:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:16 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:34:16 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:34:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:16 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Deleted allocations for instance e56b15a2-5641-442d-ac1a-3670f44dfd45
Nov 03 16:34:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c5665af-ad6b-4b1d-85b1-6f8fc761b59d tempest-DeleteServersTestJSON-1056720046 tempest-DeleteServersTestJSON-1056720046-project-member] Lock "e56b15a2-5641-442d-ac1a-3670f44dfd45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.333s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:34:29 user nova-compute[74932]: INFO nova.compute.claims [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Claim successful on node user
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:34:29 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:34:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG nova.policy [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b635150c614e459357225b83825e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be38a61a4094c9695a4111abe168c74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:34:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Creating image(s)
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "/opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "/opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "/opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.249s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.247s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk 1073741824" returned: 0 in 0.076s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Successfully created port: 59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.240s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:34:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Cannot resize image /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Ensure instance console log exists: /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Successfully updated port: 59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquired lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-changed-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Refreshing instance network info cache due to event network-changed-59260b8c-b47c-461e-bd16-cc0f8ad3b33e. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] Acquiring lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:34:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.network.neutron [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updating instance_info_cache with network_info: [{"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Releasing lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Instance network_info: |[{"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] Acquired lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.network.neutron [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Refreshing network info cache for port 59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Start _get_guest_xml network_info=[{"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:34:33 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:33 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-233470834',display_name='tempest-AttachVolumeNegativeTest-server-233470834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-233470834',id=24,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZiWLie4NWO5Lg57HK1q5JB43rh76/j2/CnWSAwgILe99DNr8Bi5PXndcWJfdQz90iuBIJhpt09EKyegUoS66rgS3kPESDt8cAXM73zel5Gzm5lCSObS+tNqnQD7lx3Tg==',key_name='tempest-keypair-1195561208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-w3nv91tc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=96c96404-d743-4c8e-bf6a-b85b5d9c2eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:34:33 user nova-compute[74932]:   <uuid>96c96404-d743-4c8e-bf6a-b85b5d9c2eb3</uuid>
Nov 03 16:34:33 user nova-compute[74932]:   <name>instance-00000018</name>
Nov 03 16:34:33 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:34:33 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:34:33 user nova-compute[74932]:   <metadata>
Nov 03 16:34:33 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:34:33 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:34:33 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeNegativeTest-server-233470834</nova:name>
Nov 03 16:34:33 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:34:33</nova:creationTime>
Nov 03 16:34:33 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:34:33 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:34:33 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:34:33 user nova-compute[74932]:       <nova:owner>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:user uuid="72b635150c614e459357225b83825e63">tempest-AttachVolumeNegativeTest-855411700-project-member</nova:user>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:project uuid="3be38a61a4094c9695a4111abe168c74">tempest-AttachVolumeNegativeTest-855411700</nova:project>
Nov 03 16:34:33 user nova-compute[74932]:       </nova:owner>
Nov 03 16:34:33 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:34:33 user nova-compute[74932]:       <nova:ports>
Nov 03 16:34:33 user nova-compute[74932]:         <nova:port uuid="59260b8c-b47c-461e-bd16-cc0f8ad3b33e">
Nov 03 16:34:33 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 16:34:33 user nova-compute[74932]:         </nova:port>
Nov 03 16:34:33 user nova-compute[74932]:       </nova:ports>
Nov 03 16:34:33 user nova-compute[74932]:     </nova:instance>
Nov 03 16:34:33 user nova-compute[74932]:   </metadata>
Nov 03 16:34:33 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:34:33 user nova-compute[74932]:     <system>
Nov 03 16:34:33 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:34:33 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:34:33 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:34:33 user nova-compute[74932]:       <entry name="serial">96c96404-d743-4c8e-bf6a-b85b5d9c2eb3</entry>
Nov 03 16:34:33 user nova-compute[74932]:       <entry name="uuid">96c96404-d743-4c8e-bf6a-b85b5d9c2eb3</entry>
Nov 03 16:34:33 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:34:33 user nova-compute[74932]:     </system>
Nov 03 16:34:33 user nova-compute[74932]:   </sysinfo>
Nov 03 16:34:33 user nova-compute[74932]:   <os>
Nov 03 16:34:33 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:34:33 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:34:33 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:34:33 user nova-compute[74932]:   </os>
Nov 03 16:34:33 user nova-compute[74932]:   <features>
Nov 03 16:34:33 user nova-compute[74932]:     <acpi/>
Nov 03 16:34:33 user nova-compute[74932]:     <apic/>
Nov 03 16:34:33 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:34:33 user nova-compute[74932]:   </features>
Nov 03 16:34:33 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:34:33 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:34:33 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:34:33 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:34:33 user nova-compute[74932]:   </clock>
Nov 03 16:34:33 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:34:33 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:34:33 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:34:33 user nova-compute[74932]:   </cpu>
Nov 03 16:34:33 user nova-compute[74932]:   <devices>
Nov 03 16:34:33 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:34:33 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:34:33 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk"/>
Nov 03 16:34:33 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:34:33 user nova-compute[74932]:     </disk>
Nov 03 16:34:33 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:34:33 user nova-compute[74932]:       <mac address="fa:16:3e:6d:45:f8"/>
Nov 03 16:34:33 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:34:33 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:34:33 user nova-compute[74932]:       <target dev="tap59260b8c-b4"/>
Nov 03 16:34:33 user nova-compute[74932]:     </interface>
Nov 03 16:34:33 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:34:33 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/console.log" append="off"/>
Nov 03 16:34:33 user nova-compute[74932]:     </serial>
Nov 03 16:34:33 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:34:33 user nova-compute[74932]:     <video>
Nov 03 16:34:33 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:34:33 user nova-compute[74932]:     </video>
Nov 03 16:34:33 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:34:33 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:34:33 user nova-compute[74932]:     </rng>
Nov 03 16:34:33 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:34:33 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:34:33 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:34:33 user nova-compute[74932]:     </memballoon>
Nov 03 16:34:33 user nova-compute[74932]:   </devices>
Nov 03 16:34:33 user nova-compute[74932]: </domain>
Nov 03 16:34:33 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-233470834',display_name='tempest-AttachVolumeNegativeTest-server-233470834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-233470834',id=24,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZiWLie4NWO5Lg57HK1q5JB43rh76/j2/CnWSAwgILe99DNr8Bi5PXndcWJfdQz90iuBIJhpt09EKyegUoS66rgS3kPESDt8cAXM73zel5Gzm5lCSObS+tNqnQD7lx3Tg==',key_name='tempest-keypair-1195561208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-w3nv91tc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=96c96404-d743-4c8e-bf6a-b85b5d9c2eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG os_vif [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6321e36-8366-586d-b88e-1cf5915d8426', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59260b8c-b4, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59260b8c-b4, col_values=(('qos', UUID('657511fb-26a7-4c2c-8959-c24f046960fb')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59260b8c-b4, col_values=(('external_ids', {'iface-id': '59260b8c-b47c-461e-bd16-cc0f8ad3b33e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:45:f8', 'vm-uuid': '96c96404-d743-4c8e-bf6a-b85b5d9c2eb3'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:33 user nova-compute[74932]: INFO os_vif [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4')
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:34:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No VIF found with MAC fa:16:3e:6d:45:f8, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:34:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:34 user nova-compute[74932]: DEBUG nova.network.neutron [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updated VIF entry in instance network info cache for port 59260b8c-b47c-461e-bd16-cc0f8ad3b33e. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:34:34 user nova-compute[74932]: DEBUG nova.network.neutron [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updating instance_info_cache with network_info: [{"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b3631a78-ccca-4759-8cbc-d8a172639b6c req-d0467ce5-fc02-4ac4-b5e9-227ca4a366d0 service nova] Releasing lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-40330a9d-e939-44d5-8226-a76071e2b10d req-ea2100f2-a29b-453a-aa9c-77b94a90dc3a service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-40330a9d-e939-44d5-8226-a76071e2b10d req-ea2100f2-a29b-453a-aa9c-77b94a90dc3a service nova] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-40330a9d-e939-44d5-8226-a76071e2b10d req-ea2100f2-a29b-453a-aa9c-77b94a90dc3a service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-40330a9d-e939-44d5-8226-a76071e2b10d req-ea2100f2-a29b-453a-aa9c-77b94a90dc3a service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-40330a9d-e939-44d5-8226-a76071e2b10d req-ea2100f2-a29b-453a-aa9c-77b94a90dc3a service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] No waiting events found dispatching network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:35 user nova-compute[74932]: WARNING nova.compute.manager [req-40330a9d-e939-44d5-8226-a76071e2b10d req-ea2100f2-a29b-453a-aa9c-77b94a90dc3a service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received unexpected event network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e for instance with vm_state building and task_state spawning.
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:36 user nova-compute[74932]: INFO nova.compute.manager [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Unshelving
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:36 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:34:36 user nova-compute[74932]: INFO nova.compute.claims [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Claim successful on node user
Nov 03 16:34:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.378s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'pci_requests' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'numa_topology' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:34:37 user nova-compute[74932]: INFO nova.compute.claims [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Claim successful on node user
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.network.neutron [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:34:37 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.policy [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2fbcaa1d5bb4249b127dcdc0875517a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f123f628d784aaaadba9dea7eb71ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:34:37 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Creating image(s)
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "/opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.209s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-c668cbb1-80e2-48a3-a8e6-40cd226ab2f0 req-3df6e215-49e5-4d69-b7d0-63363634628a service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c668cbb1-80e2-48a3-a8e6-40cd226ab2f0 req-3df6e215-49e5-4d69-b7d0-63363634628a service nova] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c668cbb1-80e2-48a3-a8e6-40cd226ab2f0 req-3df6e215-49e5-4d69-b7d0-63363634628a service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c668cbb1-80e2-48a3-a8e6-40cd226ab2f0 req-3df6e215-49e5-4d69-b7d0-63363634628a service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-c668cbb1-80e2-48a3-a8e6-40cd226ab2f0 req-3df6e215-49e5-4d69-b7d0-63363634628a service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] No waiting events found dispatching network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:37 user nova-compute[74932]: WARNING nova.compute.manager [req-c668cbb1-80e2-48a3-a8e6-40cd226ab2f0 req-3df6e215-49e5-4d69-b7d0-63363634628a service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received unexpected event network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e for instance with vm_state building and task_state spawning.
Nov 03 16:34:37 user nova-compute[74932]: INFO nova.network.neutron [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating port d809cace-ae35-4d72-83fb-e0e4a83ea558 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:38 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Instance spawned successfully.
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk 1073741824" returned: 0 in 0.064s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:38 user nova-compute[74932]: INFO nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Took 8.19 seconds to spawn the instance on the hypervisor.
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.243s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.network.neutron [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Successfully created port: 46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:34:38 user nova-compute[74932]: INFO nova.compute.manager [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Took 9.08 seconds to build instance.
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c9d10a06-db94-4941-8460-c35a71e0df84 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.188s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Cannot resize image /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Ensure instance console log exists: /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquired lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.network.neutron [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-changed-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Refreshing instance network info cache due to event network-changed-d809cace-ae35-4d72-83fb-e0e4a83ea558. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:34:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] Acquiring lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Successfully updated port: 46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Releasing lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:34:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Creating image(s)
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'trusted_certs' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] Acquired lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.network.neutron [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Refreshing network info cache for port d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.objects.base [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<358b33c3-c1e4-4f79-a5e0-0b60b9205339> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-changed-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Refreshing instance network info cache due to event network-changed-46ad95a9-cffc-4068-bd45-866e2c328c5e. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] Acquiring lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:39 user nova-compute[74932]: DEBUG nova.network.neutron [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:34:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.images [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] 52bae536-a588-4148-b555-4c31b7c0e2a5 was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.part /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updated VIF entry in instance network info cache for port d809cace-ae35-4d72-83fb-e0e4a83ea558. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updating instance_info_cache with network_info: [{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b2a946bf-841a-4b27-a3f5-44bb3dbd254a req-1bad9f41-746f-4fb4-85a1-83d0b6ba24f6 service nova] Releasing lock "refresh_cache-358b33c3-c1e4-4f79-a5e0-0b60b9205339" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Instance network_info: |[{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] Acquired lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Refreshing network info cache for port 46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Start _get_guest_xml network_info=[{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:34:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-755999671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-755999671',id=25,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-lyjhd6u0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:34:38Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=11fb8f0c-e8fc-4248-a522-582a859fca29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'pci_devices' on Instance uuid 11fb8f0c-e8fc-4248-a522-582a859fca29 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.part /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.converted" returned: 0 in 0.526s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:34:41 user nova-compute[74932]:   <uuid>11fb8f0c-e8fc-4248-a522-582a859fca29</uuid>
Nov 03 16:34:41 user nova-compute[74932]:   <name>instance-00000019</name>
Nov 03 16:34:41 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:34:41 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:34:41 user nova-compute[74932]:   <metadata>
Nov 03 16:34:41 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:34:41 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:34:41 user nova-compute[74932]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-755999671</nova:name>
Nov 03 16:34:41 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:34:41</nova:creationTime>
Nov 03 16:34:41 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:34:41 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:34:41 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:34:41 user nova-compute[74932]:       <nova:owner>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:user uuid="f2fbcaa1d5bb4249b127dcdc0875517a">tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member</nova:user>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:project uuid="5f123f628d784aaaadba9dea7eb71ce2">tempest-ServerBootFromVolumeStableRescueTest-2083155834</nova:project>
Nov 03 16:34:41 user nova-compute[74932]:       </nova:owner>
Nov 03 16:34:41 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:34:41 user nova-compute[74932]:       <nova:ports>
Nov 03 16:34:41 user nova-compute[74932]:         <nova:port uuid="46ad95a9-cffc-4068-bd45-866e2c328c5e">
Nov 03 16:34:41 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 16:34:41 user nova-compute[74932]:         </nova:port>
Nov 03 16:34:41 user nova-compute[74932]:       </nova:ports>
Nov 03 16:34:41 user nova-compute[74932]:     </nova:instance>
Nov 03 16:34:41 user nova-compute[74932]:   </metadata>
Nov 03 16:34:41 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:34:41 user nova-compute[74932]:     <system>
Nov 03 16:34:41 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:34:41 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:34:41 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:34:41 user nova-compute[74932]:       <entry name="serial">11fb8f0c-e8fc-4248-a522-582a859fca29</entry>
Nov 03 16:34:41 user nova-compute[74932]:       <entry name="uuid">11fb8f0c-e8fc-4248-a522-582a859fca29</entry>
Nov 03 16:34:41 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:34:41 user nova-compute[74932]:     </system>
Nov 03 16:34:41 user nova-compute[74932]:   </sysinfo>
Nov 03 16:34:41 user nova-compute[74932]:   <os>
Nov 03 16:34:41 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:34:41 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:34:41 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:34:41 user nova-compute[74932]:   </os>
Nov 03 16:34:41 user nova-compute[74932]:   <features>
Nov 03 16:34:41 user nova-compute[74932]:     <acpi/>
Nov 03 16:34:41 user nova-compute[74932]:     <apic/>
Nov 03 16:34:41 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:34:41 user nova-compute[74932]:   </features>
Nov 03 16:34:41 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:34:41 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:34:41 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:34:41 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:34:41 user nova-compute[74932]:   </clock>
Nov 03 16:34:41 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:34:41 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:34:41 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:34:41 user nova-compute[74932]:   </cpu>
Nov 03 16:34:41 user nova-compute[74932]:   <devices>
Nov 03 16:34:41 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:34:41 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:34:41 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk"/>
Nov 03 16:34:41 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:34:41 user nova-compute[74932]:     </disk>
Nov 03 16:34:41 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:34:41 user nova-compute[74932]:       <mac address="fa:16:3e:74:0a:20"/>
Nov 03 16:34:41 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:34:41 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:34:41 user nova-compute[74932]:       <target dev="tap46ad95a9-cf"/>
Nov 03 16:34:41 user nova-compute[74932]:     </interface>
Nov 03 16:34:41 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:34:41 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/console.log" append="off"/>
Nov 03 16:34:41 user nova-compute[74932]:     </serial>
Nov 03 16:34:41 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:34:41 user nova-compute[74932]:     <video>
Nov 03 16:34:41 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:34:41 user nova-compute[74932]:     </video>
Nov 03 16:34:41 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:34:41 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:34:41 user nova-compute[74932]:     </rng>
Nov 03 16:34:41 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:34:41 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:34:41 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:34:41 user nova-compute[74932]:     </memballoon>
Nov 03 16:34:41 user nova-compute[74932]:   </devices>
Nov 03 16:34:41 user nova-compute[74932]: </domain>
Nov 03 16:34:41 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-755999671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-755999671',id=25,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-lyjhd6u0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:34:38Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=11fb8f0c-e8fc-4248-a522-582a859fca29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG os_vif [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfe9ce5d-befd-51fe-9ac6-399483909b36', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46ad95a9-cf, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46ad95a9-cf, col_values=(('qos', UUID('cd5db0cc-6f57-4afe-b0fd-6ac30d514257')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46ad95a9-cf, col_values=(('external_ids', {'iface-id': '46ad95a9-cffc-4068-bd45-866e2c328c5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:0a:20', 'vm-uuid': '11fb8f0c-e8fc-4248-a522-582a859fca29'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:41 user nova-compute[74932]: INFO os_vif [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf')
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No VIF found with MAC fa:16:3e:74:0a:20, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.518s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updated VIF entry in instance network info cache for port 46ad95a9-cffc-4068-bd45-866e2c328c5e. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updating instance_info_cache with network_info: [{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf --force-share --output=json" returned: 0 in 0.226s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ef7eca9e-fbca-4275-a7ee-fe26108a7f74 req-53fb564f-2712-4d4d-8910-e7fa896f7deb service nova] Releasing lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf --force-share --output=json" returned: 0 in 0.245s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf,backing_fmt=raw /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf,backing_fmt=raw /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk 1073741824" returned: 0 in 0.075s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/004b4ab84c267ec60b6c4eb856ae8e9eb5bcb6bf --force-share --output=json" returned: 0 in 0.241s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'migration_context' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG nova.objects.base [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<358b33c3-c1e4-4f79-a5e0-0b60b9205339> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:34:42 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Rebasing disk image.
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.244s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 -F raw /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-8940930f-103d-4118-83b1-cd1cb6dd2a78 req-9f66c27f-8685-4334-a364-08487358dcd8 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8940930f-103d-4118-83b1-cd1cb6dd2a78 req-9f66c27f-8685-4334-a364-08487358dcd8 service nova] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8940930f-103d-4118-83b1-cd1cb6dd2a78 req-9f66c27f-8685-4334-a364-08487358dcd8 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8940930f-103d-4118-83b1-cd1cb6dd2a78 req-9f66c27f-8685-4334-a364-08487358dcd8 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-8940930f-103d-4118-83b1-cd1cb6dd2a78 req-9f66c27f-8685-4334-a364-08487358dcd8 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] No waiting events found dispatching network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:43 user nova-compute[74932]: WARNING nova.compute.manager [req-8940930f-103d-4118-83b1-cd1cb6dd2a78 req-9f66c27f-8685-4334-a364-08487358dcd8 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received unexpected event network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e for instance with vm_state building and task_state spawning.
Nov 03 16:34:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-15e277fb-920e-4064-9e34-f9329af4c8bb req-b1cdbab2-3d05-438c-88df-a230b233d4f6 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-15e277fb-920e-4064-9e34-f9329af4c8bb req-b1cdbab2-3d05-438c-88df-a230b233d4f6 service nova] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-15e277fb-920e-4064-9e34-f9329af4c8bb req-b1cdbab2-3d05-438c-88df-a230b233d4f6 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-15e277fb-920e-4064-9e34-f9329af4c8bb req-b1cdbab2-3d05-438c-88df-a230b233d4f6 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-15e277fb-920e-4064-9e34-f9329af4c8bb req-b1cdbab2-3d05-438c-88df-a230b233d4f6 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] No waiting events found dispatching network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:45 user nova-compute[74932]: WARNING nova.compute.manager [req-15e277fb-920e-4064-9e34-f9329af4c8bb req-b1cdbab2-3d05-438c-88df-a230b233d4f6 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received unexpected event network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e for instance with vm_state building and task_state spawning.
Nov 03 16:34:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 -F raw /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk" returned: 0 in 3.100s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Ensure instance console log exists: /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Start _get_guest_xml network_info=[{"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='36a808c2e706b8cc26523a0d73826e22',container_format='bare',created_at=2023-11-03T16:32:43Z,direct_url=<?>,disk_format='qcow2',id=52bae536-a588-4148-b555-4c31b7c0e2a5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1768994889-shelved',owner='b101d0f7f99a41f699e3f2701cc35248',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T16:32:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:34:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='36a808c2e706b8cc26523a0d73826e22',container_format='bare',created_at=2023-11-03T16:32:43Z,direct_url=<?>,disk_format='qcow2',id=52bae536-a588-4148-b555-4c31b7c0e2a5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1768994889-shelved',owner='b101d0f7f99a41f699e3f2701cc35248',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T16:32:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'vcpu_model' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.objects.base [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<358b33c3-c1e4-4f79-a5e0-0b60b9205339> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768994889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768994889',id=17,image_ref='52bae536-a588-4148-b555-4c31b7c0e2a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-360156465',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-oyk2eyi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member',shelved_at='2023-11-03T16:32:48.245807',shelved_host='user',shelved_image_id='52bae536-a588-4148-b555-4c31b7c0e2a5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=358b33c3-c1e4-4f79-a5e0-0b60b9205339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'pci_devices' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.objects.base [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Object Instance<358b33c3-c1e4-4f79-a5e0-0b60b9205339> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:34:46 user nova-compute[74932]:   <uuid>358b33c3-c1e4-4f79-a5e0-0b60b9205339</uuid>
Nov 03 16:34:46 user nova-compute[74932]:   <name>instance-00000011</name>
Nov 03 16:34:46 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:34:46 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:34:46 user nova-compute[74932]:   <metadata>
Nov 03 16:34:46 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:34:46 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:34:46 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1768994889</nova:name>
Nov 03 16:34:46 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:34:46</nova:creationTime>
Nov 03 16:34:46 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:34:46 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:34:46 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:34:46 user nova-compute[74932]:       <nova:owner>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:user uuid="6fd49e83fa0846d191cb4cf0719ba038">tempest-AttachVolumeShelveTestJSON-1586732873-project-member</nova:user>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:project uuid="b101d0f7f99a41f699e3f2701cc35248">tempest-AttachVolumeShelveTestJSON-1586732873</nova:project>
Nov 03 16:34:46 user nova-compute[74932]:       </nova:owner>
Nov 03 16:34:46 user nova-compute[74932]:       <nova:root type="image" uuid="52bae536-a588-4148-b555-4c31b7c0e2a5"/>
Nov 03 16:34:46 user nova-compute[74932]:       <nova:ports>
Nov 03 16:34:46 user nova-compute[74932]:         <nova:port uuid="d809cace-ae35-4d72-83fb-e0e4a83ea558">
Nov 03 16:34:46 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 16:34:46 user nova-compute[74932]:         </nova:port>
Nov 03 16:34:46 user nova-compute[74932]:       </nova:ports>
Nov 03 16:34:46 user nova-compute[74932]:     </nova:instance>
Nov 03 16:34:46 user nova-compute[74932]:   </metadata>
Nov 03 16:34:46 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:34:46 user nova-compute[74932]:     <system>
Nov 03 16:34:46 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:34:46 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:34:46 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:34:46 user nova-compute[74932]:       <entry name="serial">358b33c3-c1e4-4f79-a5e0-0b60b9205339</entry>
Nov 03 16:34:46 user nova-compute[74932]:       <entry name="uuid">358b33c3-c1e4-4f79-a5e0-0b60b9205339</entry>
Nov 03 16:34:46 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:34:46 user nova-compute[74932]:     </system>
Nov 03 16:34:46 user nova-compute[74932]:   </sysinfo>
Nov 03 16:34:46 user nova-compute[74932]:   <os>
Nov 03 16:34:46 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:34:46 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:34:46 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:34:46 user nova-compute[74932]:   </os>
Nov 03 16:34:46 user nova-compute[74932]:   <features>
Nov 03 16:34:46 user nova-compute[74932]:     <acpi/>
Nov 03 16:34:46 user nova-compute[74932]:     <apic/>
Nov 03 16:34:46 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:34:46 user nova-compute[74932]:   </features>
Nov 03 16:34:46 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:34:46 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:34:46 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:34:46 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:34:46 user nova-compute[74932]:   </clock>
Nov 03 16:34:46 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:34:46 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:34:46 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:34:46 user nova-compute[74932]:   </cpu>
Nov 03 16:34:46 user nova-compute[74932]:   <devices>
Nov 03 16:34:46 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:34:46 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:34:46 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk"/>
Nov 03 16:34:46 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:34:46 user nova-compute[74932]:     </disk>
Nov 03 16:34:46 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:34:46 user nova-compute[74932]:       <mac address="fa:16:3e:90:ff:74"/>
Nov 03 16:34:46 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:34:46 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:34:46 user nova-compute[74932]:       <target dev="tapd809cace-ae"/>
Nov 03 16:34:46 user nova-compute[74932]:     </interface>
Nov 03 16:34:46 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:34:46 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/console.log" append="off"/>
Nov 03 16:34:46 user nova-compute[74932]:     </serial>
Nov 03 16:34:46 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:34:46 user nova-compute[74932]:     <video>
Nov 03 16:34:46 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:34:46 user nova-compute[74932]:     </video>
Nov 03 16:34:46 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:34:46 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:34:46 user nova-compute[74932]:     </rng>
Nov 03 16:34:46 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:34:46 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:34:46 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:34:46 user nova-compute[74932]:     </memballoon>
Nov 03 16:34:46 user nova-compute[74932]:   </devices>
Nov 03 16:34:46 user nova-compute[74932]: </domain>
Nov 03 16:34:46 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768994889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768994889',id=17,image_ref='52bae536-a588-4148-b555-4c31b7c0e2a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-360156465',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-oyk2eyi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member',shelved_at='2023-11-03T16:32:48.245807',shelved_host='user',shelved_image_id='52bae536-a588-4148-b555-4c31b7c0e2a5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=358b33c3-c1e4-4f79-a5e0-0b60b9205339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG os_vif [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dd31c87-c995-587b-8cf6-3e921c497bdb', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd809cace-ae, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd809cace-ae, col_values=(('qos', UUID('ff2b3ee1-561a-4db7-8592-9038ac6a03ca')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd809cace-ae, col_values=(('external_ids', {'iface-id': 'd809cace-ae35-4d72-83fb-e0e4a83ea558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ff:74', 'vm-uuid': '358b33c3-c1e4-4f79-a5e0-0b60b9205339'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:46 user nova-compute[74932]: INFO os_vif [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae')
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] No VIF found with MAC fa:16:3e:90:ff:74, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:34:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Instance spawned successfully.
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:34:46 user nova-compute[74932]: INFO nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Took 8.94 seconds to spawn the instance on the hypervisor.
Nov 03 16:34:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:34:46 user nova-compute[74932]: INFO nova.compute.manager [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Took 9.93 seconds to build instance.
Nov 03 16:34:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-daf38ec6-9d32-43ee-801c-630e8817e70e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.090s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-28800283-dedc-473d-946b-f2d8c3e841bd req-d60383db-d2a5-4aab-817e-850c073a67f3 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-28800283-dedc-473d-946b-f2d8c3e841bd req-d60383db-d2a5-4aab-817e-850c073a67f3 service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-28800283-dedc-473d-946b-f2d8c3e841bd req-d60383db-d2a5-4aab-817e-850c073a67f3 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-28800283-dedc-473d-946b-f2d8c3e841bd req-d60383db-d2a5-4aab-817e-850c073a67f3 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-28800283-dedc-473d-946b-f2d8c3e841bd req-d60383db-d2a5-4aab-817e-850c073a67f3 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:48 user nova-compute[74932]: WARNING nova.compute.manager [req-28800283-dedc-473d-946b-f2d8c3e841bd req-d60383db-d2a5-4aab-817e-850c073a67f3 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 16:34:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-d984c2ad-7251-441b-a747-c840b5a1e265 req-6ad423ad-8d35-4bfc-be15-b1f54031aea3 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d984c2ad-7251-441b-a747-c840b5a1e265 req-6ad423ad-8d35-4bfc-be15-b1f54031aea3 service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d984c2ad-7251-441b-a747-c840b5a1e265 req-6ad423ad-8d35-4bfc-be15-b1f54031aea3 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d984c2ad-7251-441b-a747-c840b5a1e265 req-6ad423ad-8d35-4bfc-be15-b1f54031aea3 service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-d984c2ad-7251-441b-a747-c840b5a1e265 req-6ad423ad-8d35-4bfc-be15-b1f54031aea3 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:34:50 user nova-compute[74932]: WARNING nova.compute.manager [req-d984c2ad-7251-441b-a747-c840b5a1e265 req-6ad423ad-8d35-4bfc-be15-b1f54031aea3 service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 16:34:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:34:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance spawned successfully.
Nov 03 16:34:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:34:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b0da40a1-74e1-49f3-8cb1-579209f3a4b5 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.194s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:34:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:34:57 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:57 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=25.33221435546875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e72d836e-bb58-4a3a-95e2-116255664468 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 358b33c3-c1e4-4f79-a5e0-0b60b9205339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:34:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:34:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:34:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:35:07 user nova-compute[74932]: INFO nova.compute.claims [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Claim successful on node user
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:35:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:35:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:35:07 user nova-compute[74932]: DEBUG nova.policy [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90fa01b533204995b57b88b0a4aac138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8cbb942aff476ebf7cca3968447573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:35:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Creating image(s)
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.248s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.214s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk 1073741824" returned: 0 in 0.073s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Successfully created port: ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.219s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:35:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Cannot resize image /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Ensure instance console log exists: /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Successfully updated port: ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquired lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-changed-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Refreshing instance network info cache due to event network-changed-ce1737f3-6745-49e5-89de-7cd37dac064b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] Acquiring lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updating instance_info_cache with network_info: [{"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Releasing lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance network_info: |[{"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] Acquired lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.neutron [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Refreshing network info cache for port ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Start _get_guest_xml network_info=[{"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:35:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:35:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215066673',display_name='tempest-tempest.common.compute-instance-215066673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-215066673',id=26,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVvr0cOtKAT7q7hEiUPtDBtsG9isgtmhqmtyfJlhfgje5zhIt7ontVt7eFV354uWtYe4DTjFXkkopLougoy6YNRz/8ZrTy44IyY937kIpKjwA/qUZYUJ0HOSdd+yheqxw==',key_name='tempest-keypair-593339944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-fehc8j4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=5aa105d4-e07c-48aa-8931-528c4c924e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.objects.instance [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:35:09 user nova-compute[74932]:   <uuid>5aa105d4-e07c-48aa-8931-528c4c924e03</uuid>
Nov 03 16:35:09 user nova-compute[74932]:   <name>instance-0000001a</name>
Nov 03 16:35:09 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:35:09 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:35:09 user nova-compute[74932]:   <metadata>
Nov 03 16:35:09 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:35:09 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:35:09 user nova-compute[74932]:       <nova:name>tempest-tempest.common.compute-instance-215066673</nova:name>
Nov 03 16:35:09 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:35:09</nova:creationTime>
Nov 03 16:35:09 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:35:09 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:35:09 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:35:09 user nova-compute[74932]:       <nova:owner>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:user uuid="90fa01b533204995b57b88b0a4aac138">tempest-ServerActionsTestOtherA-1516695200-project-member</nova:user>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:project uuid="9a8cbb942aff476ebf7cca3968447573">tempest-ServerActionsTestOtherA-1516695200</nova:project>
Nov 03 16:35:09 user nova-compute[74932]:       </nova:owner>
Nov 03 16:35:09 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:35:09 user nova-compute[74932]:       <nova:ports>
Nov 03 16:35:09 user nova-compute[74932]:         <nova:port uuid="ce1737f3-6745-49e5-89de-7cd37dac064b">
Nov 03 16:35:09 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:35:09 user nova-compute[74932]:         </nova:port>
Nov 03 16:35:09 user nova-compute[74932]:       </nova:ports>
Nov 03 16:35:09 user nova-compute[74932]:     </nova:instance>
Nov 03 16:35:09 user nova-compute[74932]:   </metadata>
Nov 03 16:35:09 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:35:09 user nova-compute[74932]:     <system>
Nov 03 16:35:09 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:35:09 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:35:09 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:35:09 user nova-compute[74932]:       <entry name="serial">5aa105d4-e07c-48aa-8931-528c4c924e03</entry>
Nov 03 16:35:09 user nova-compute[74932]:       <entry name="uuid">5aa105d4-e07c-48aa-8931-528c4c924e03</entry>
Nov 03 16:35:09 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:35:09 user nova-compute[74932]:     </system>
Nov 03 16:35:09 user nova-compute[74932]:   </sysinfo>
Nov 03 16:35:09 user nova-compute[74932]:   <os>
Nov 03 16:35:09 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:35:09 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:35:09 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:35:09 user nova-compute[74932]:   </os>
Nov 03 16:35:09 user nova-compute[74932]:   <features>
Nov 03 16:35:09 user nova-compute[74932]:     <acpi/>
Nov 03 16:35:09 user nova-compute[74932]:     <apic/>
Nov 03 16:35:09 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:35:09 user nova-compute[74932]:   </features>
Nov 03 16:35:09 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:35:09 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:35:09 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:35:09 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:35:09 user nova-compute[74932]:   </clock>
Nov 03 16:35:09 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:35:09 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:35:09 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:35:09 user nova-compute[74932]:   </cpu>
Nov 03 16:35:09 user nova-compute[74932]:   <devices>
Nov 03 16:35:09 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:35:09 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:35:09 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk"/>
Nov 03 16:35:09 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:35:09 user nova-compute[74932]:     </disk>
Nov 03 16:35:09 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:35:09 user nova-compute[74932]:       <mac address="fa:16:3e:48:58:95"/>
Nov 03 16:35:09 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:35:09 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:35:09 user nova-compute[74932]:       <target dev="tapce1737f3-67"/>
Nov 03 16:35:09 user nova-compute[74932]:     </interface>
Nov 03 16:35:09 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:35:09 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/console.log" append="off"/>
Nov 03 16:35:09 user nova-compute[74932]:     </serial>
Nov 03 16:35:09 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:35:09 user nova-compute[74932]:     <video>
Nov 03 16:35:09 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:35:09 user nova-compute[74932]:     </video>
Nov 03 16:35:09 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:35:09 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:35:09 user nova-compute[74932]:     </rng>
Nov 03 16:35:09 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:35:09 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:35:09 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:35:09 user nova-compute[74932]:     </memballoon>
Nov 03 16:35:09 user nova-compute[74932]:   </devices>
Nov 03 16:35:09 user nova-compute[74932]: </domain>
Nov 03 16:35:09 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215066673',display_name='tempest-tempest.common.compute-instance-215066673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-215066673',id=26,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVvr0cOtKAT7q7hEiUPtDBtsG9isgtmhqmtyfJlhfgje5zhIt7ontVt7eFV354uWtYe4DTjFXkkopLougoy6YNRz/8ZrTy44IyY937kIpKjwA/qUZYUJ0HOSdd+yheqxw==',key_name='tempest-keypair-593339944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-fehc8j4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=5aa105d4-e07c-48aa-8931-528c4c924e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG os_vif [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ae5d9e3-fbda-5799-8bc8-ccff61e9aea4', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce1737f3-67, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce1737f3-67, col_values=(('qos', UUID('482f349e-cfff-484a-8856-f9ad0bd361a1')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce1737f3-67, col_values=(('external_ids', {'iface-id': 'ce1737f3-6745-49e5-89de-7cd37dac064b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:58:95', 'vm-uuid': '5aa105d4-e07c-48aa-8931-528c4c924e03'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:10 user nova-compute[74932]: INFO os_vif [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67')
Nov 03 16:35:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No VIF found with MAC fa:16:3e:48:58:95, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updated VIF entry in instance network info cache for port ce1737f3-6745-49e5-89de-7cd37dac064b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updating instance_info_cache with network_info: [{"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b93ce0dc-3ff3-4e32-9818-1fbe4e9139ac req-2e45828e-4c7b-4e89-965b-3dd46dac0edc service nova] Releasing lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-c36cb01f-411b-499e-883a-44a51c7799cc req-957ae56a-3460-4cdc-8c1c-209d650fe4fb service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c36cb01f-411b-499e-883a-44a51c7799cc req-957ae56a-3460-4cdc-8c1c-209d650fe4fb service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c36cb01f-411b-499e-883a-44a51c7799cc req-957ae56a-3460-4cdc-8c1c-209d650fe4fb service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c36cb01f-411b-499e-883a-44a51c7799cc req-957ae56a-3460-4cdc-8c1c-209d650fe4fb service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-c36cb01f-411b-499e-883a-44a51c7799cc req-957ae56a-3460-4cdc-8c1c-209d650fe4fb service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:11 user nova-compute[74932]: WARNING nova.compute.manager [req-c36cb01f-411b-499e-883a-44a51c7799cc req-957ae56a-3460-4cdc-8c1c-209d650fe4fb service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state building and task_state spawning.
Nov 03 16:35:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:35:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance spawned successfully.
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c9649e3-e8d6-4d40-a6ed-0258932c075c req-74c93d94-8171-4753-9812-a6438c5c6a68 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c9649e3-e8d6-4d40-a6ed-0258932c075c req-74c93d94-8171-4753-9812-a6438c5c6a68 service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c9649e3-e8d6-4d40-a6ed-0258932c075c req-74c93d94-8171-4753-9812-a6438c5c6a68 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5c9649e3-e8d6-4d40-a6ed-0258932c075c req-74c93d94-8171-4753-9812-a6438c5c6a68 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-5c9649e3-e8d6-4d40-a6ed-0258932c075c req-74c93d94-8171-4753-9812-a6438c5c6a68 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:13 user nova-compute[74932]: WARNING nova.compute.manager [req-5c9649e3-e8d6-4d40-a6ed-0258932c075c req-74c93d94-8171-4753-9812-a6438c5c6a68 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state building and task_state spawning.
Nov 03 16:35:13 user nova-compute[74932]: INFO nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 03 16:35:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:35:13 user nova-compute[74932]: INFO nova.compute.manager [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Took 6.68 seconds to build instance.
Nov 03 16:35:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dec328a4-3487-4aad-8f43-22f9ac09b6dd tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.789s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "e72d836e-bb58-4a3a-95e2-116255664468" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:14 user nova-compute[74932]: INFO nova.compute.manager [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Terminating instance
Nov 03 16:35:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-62523f14-2f0d-4f6a-8f84-dd76a268a5ac req-5584ba00-37b8-4f66-86f5-eebb7fb644f2 service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-vif-unplugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-62523f14-2f0d-4f6a-8f84-dd76a268a5ac req-5584ba00-37b8-4f66-86f5-eebb7fb644f2 service nova] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-62523f14-2f0d-4f6a-8f84-dd76a268a5ac req-5584ba00-37b8-4f66-86f5-eebb7fb644f2 service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-62523f14-2f0d-4f6a-8f84-dd76a268a5ac req-5584ba00-37b8-4f66-86f5-eebb7fb644f2 service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-62523f14-2f0d-4f6a-8f84-dd76a268a5ac req-5584ba00-37b8-4f66-86f5-eebb7fb644f2 service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] No waiting events found dispatching network-vif-unplugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-62523f14-2f0d-4f6a-8f84-dd76a268a5ac req-5584ba00-37b8-4f66-86f5-eebb7fb644f2 service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-vif-unplugged-830ed123-a619-4228-85ac-b21dd0279735 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:35:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Instance destroyed successfully.
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lazy-loading 'resources' on Instance uuid e72d836e-bb58-4a3a-95e2-116255664468 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-344167236',display_name='tempest-VolumesActionsTest-instance-344167236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-344167236',id=22,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:33:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='660be27a2adc4e15b5585a9d90bb5d8a',ramdisk_id='',reservation_id='r-crk3tot7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-453500561',owner_user_name='tempest-VolumesActionsTest-453500561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:33:30Z,user_data=None,user_id='55c678331ab147d8970f06830f55853b',uuid=e72d836e-bb58-4a3a-95e2-116255664468,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converting VIF {"id": "830ed123-a619-4228-85ac-b21dd0279735", "address": "fa:16:3e:66:d3:c8", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830ed123-a6", "ovs_interfaceid": "830ed123-a619-4228-85ac-b21dd0279735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG os_vif [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap830ed123-a6, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05ad4a84-5f2b-402b-b4b7-ee9b62878695) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:35:15 user nova-compute[74932]: INFO os_vif [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d3:c8,bridge_name='br-int',has_traffic_filtering=True,id=830ed123-a619-4228-85ac-b21dd0279735,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830ed123-a6')
Nov 03 16:35:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Deleting instance files /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468_del
Nov 03 16:35:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Deletion of /opt/stack/data/nova/instances/e72d836e-bb58-4a3a-95e2-116255664468_del complete
Nov 03 16:35:16 user nova-compute[74932]: INFO nova.compute.manager [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e72d836e-bb58-4a3a-95e2-116255664468] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-changed-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Refreshing instance network info cache due to event network-changed-032a623c-ee7b-4830-8652-1c825c7f9bbb. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] Acquiring lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] Acquired lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Refreshing network info cache for port 032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:16 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Took 0.62 seconds to deallocate network for instance.
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updated VIF entry in instance network info cache for port 032a623c-ee7b-4830-8652-1c825c7f9bbb. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating instance_info_cache with network_info: [{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ac3a1a48-634c-4ca7-a039-4e8f4625f2c3 req-9bf15e97-d9be-4253-8d5e-f29409599c8a service nova] Releasing lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG nova.objects.instance [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'flavor' on Instance uuid ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:17 user nova-compute[74932]: INFO nova.compute.manager [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Attaching volume 73aaf629-ae27-467d-b367-d2240a6b890c to /dev/vdb
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:17 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Deleted allocations for instance e72d836e-bb58-4a3a-95e2-116255664468
Nov 03 16:35:17 user nova-compute[74932]: DEBUG os_brick.utils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c749c-7317-48cd-9576-b8adddcad9b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72a37d-fac6-43ff-ab0e-5b3b93477bbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c136aa-c9fd-4b8c-9568-117e10548441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[904f2a86-4054-4d68-bd0e-9dc2323df038]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-b65d8e24-e46b-4029-9734-956108c2eaf6 req-8c560459-524a-40fc-b9fb-d0a3ce92ec4b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b65d8e24-e46b-4029-9734-956108c2eaf6 req-8c560459-524a-40fc-b9fb-d0a3ce92ec4b service nova] Acquiring lock "e72d836e-bb58-4a3a-95e2-116255664468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b65d8e24-e46b-4029-9734-956108c2eaf6 req-8c560459-524a-40fc-b9fb-d0a3ce92ec4b service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b65d8e24-e46b-4029-9734-956108c2eaf6 req-8c560459-524a-40fc-b9fb-d0a3ce92ec4b service nova] Lock "e72d836e-bb58-4a3a-95e2-116255664468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-b65d8e24-e46b-4029-9734-956108c2eaf6 req-8c560459-524a-40fc-b9fb-d0a3ce92ec4b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] No waiting events found dispatching network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:17 user nova-compute[74932]: WARNING nova.compute.manager [req-b65d8e24-e46b-4029-9734-956108c2eaf6 req-8c560459-524a-40fc-b9fb-d0a3ce92ec4b service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received unexpected event network-vif-plugged-830ed123-a619-4228-85ac-b21dd0279735 for instance with vm_state deleted and task_state None.
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b7b2f6eb-78fb-456b-baa1-ed7dc6d13a15 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "e72d836e-bb58-4a3a-95e2-116255664468" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:35:17 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:35:17 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1202d-5e47-4b5f-a032-255168f1497b]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG os_brick.utils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating existing volume attachment record: 56f33166-c59c-4fdc-882c-55137a4ece87 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:35:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-b54c79f1-e3f2-432b-9beb-d64797d2d9c9 req-e77495a8-56b3-4788-8fbb-00f464fee68d service nova] [instance: e72d836e-bb58-4a3a-95e2-116255664468] Received event network-vif-deleted-830ed123-a619-4228-85ac-b21dd0279735 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:35:41 user nova-compute[74932]: INFO nova.compute.claims [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Claim successful on node user
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:35:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.policy [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72961e6dbb884091a9b3fa92da558ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708c7a9d408f4b6e9300246c0bd84f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:35:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Creating image(s)
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk 1073741824" returned: 0 in 0.062s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Successfully created port: 2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.258s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Cannot resize image /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Ensure instance console log exists: /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Successfully updated port: 2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing instance network info cache due to event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance network_info: |[{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.neutron [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Start _get_guest_xml network_info=[{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:35:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:35:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1558430644',display_name='tempest-ServerStableDeviceRescueTest-server-1558430644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1558430644',id=27,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOfnjxg1k3RnokJ4NfBnrK/mCaj28IuLgVS3j/qIcWiUnTJpvcQ+uVs1nHFqCd0jvtrSIQq6p/ff5t/X/f1lnz1UmiXu8t29wfw9LnfbTcubbeJTpTDglgAw9x/hp9/wg==',key_name='tempest-keypair-22406688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='708c7a9d408f4b6e9300246c0bd84f73',ramdisk_id='',reservation_id='r-30ezqyyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-40984610',owner_user_name='tempest-ServerStableDeviceRescueTest-40984610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72961e6dbb884091a9b3fa92da558ef4',uuid=f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converting VIF {"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'pci_devices' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:35:43 user nova-compute[74932]:   <uuid>f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16</uuid>
Nov 03 16:35:43 user nova-compute[74932]:   <name>instance-0000001b</name>
Nov 03 16:35:43 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:35:43 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:35:43 user nova-compute[74932]:   <metadata>
Nov 03 16:35:43 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:35:43 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:35:43 user nova-compute[74932]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1558430644</nova:name>
Nov 03 16:35:43 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:35:43</nova:creationTime>
Nov 03 16:35:43 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:35:43 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:35:43 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:35:43 user nova-compute[74932]:       <nova:owner>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:user uuid="72961e6dbb884091a9b3fa92da558ef4">tempest-ServerStableDeviceRescueTest-40984610-project-member</nova:user>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:project uuid="708c7a9d408f4b6e9300246c0bd84f73">tempest-ServerStableDeviceRescueTest-40984610</nova:project>
Nov 03 16:35:43 user nova-compute[74932]:       </nova:owner>
Nov 03 16:35:43 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:35:43 user nova-compute[74932]:       <nova:ports>
Nov 03 16:35:43 user nova-compute[74932]:         <nova:port uuid="2002e939-5f21-48cf-8aae-7868f7c6992a">
Nov 03 16:35:43 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 16:35:43 user nova-compute[74932]:         </nova:port>
Nov 03 16:35:43 user nova-compute[74932]:       </nova:ports>
Nov 03 16:35:43 user nova-compute[74932]:     </nova:instance>
Nov 03 16:35:43 user nova-compute[74932]:   </metadata>
Nov 03 16:35:43 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:35:43 user nova-compute[74932]:     <system>
Nov 03 16:35:43 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:35:43 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:35:43 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:35:43 user nova-compute[74932]:       <entry name="serial">f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16</entry>
Nov 03 16:35:43 user nova-compute[74932]:       <entry name="uuid">f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16</entry>
Nov 03 16:35:43 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:35:43 user nova-compute[74932]:     </system>
Nov 03 16:35:43 user nova-compute[74932]:   </sysinfo>
Nov 03 16:35:43 user nova-compute[74932]:   <os>
Nov 03 16:35:43 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:35:43 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:35:43 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:35:43 user nova-compute[74932]:   </os>
Nov 03 16:35:43 user nova-compute[74932]:   <features>
Nov 03 16:35:43 user nova-compute[74932]:     <acpi/>
Nov 03 16:35:43 user nova-compute[74932]:     <apic/>
Nov 03 16:35:43 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:35:43 user nova-compute[74932]:   </features>
Nov 03 16:35:43 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:35:43 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:35:43 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:35:43 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:35:43 user nova-compute[74932]:   </clock>
Nov 03 16:35:43 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:35:43 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:35:43 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:35:43 user nova-compute[74932]:   </cpu>
Nov 03 16:35:43 user nova-compute[74932]:   <devices>
Nov 03 16:35:43 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:35:43 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:35:43 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk"/>
Nov 03 16:35:43 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:35:43 user nova-compute[74932]:     </disk>
Nov 03 16:35:43 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:35:43 user nova-compute[74932]:       <mac address="fa:16:3e:a1:c5:2e"/>
Nov 03 16:35:43 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:35:43 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:35:43 user nova-compute[74932]:       <target dev="tap2002e939-5f"/>
Nov 03 16:35:43 user nova-compute[74932]:     </interface>
Nov 03 16:35:43 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:35:43 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/console.log" append="off"/>
Nov 03 16:35:43 user nova-compute[74932]:     </serial>
Nov 03 16:35:43 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:35:43 user nova-compute[74932]:     <video>
Nov 03 16:35:43 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:35:43 user nova-compute[74932]:     </video>
Nov 03 16:35:43 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:35:43 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:35:43 user nova-compute[74932]:     </rng>
Nov 03 16:35:43 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:35:43 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:35:43 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:35:43 user nova-compute[74932]:     </memballoon>
Nov 03 16:35:43 user nova-compute[74932]:   </devices>
Nov 03 16:35:43 user nova-compute[74932]: </domain>
Nov 03 16:35:43 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1558430644',display_name='tempest-ServerStableDeviceRescueTest-server-1558430644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1558430644',id=27,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOfnjxg1k3RnokJ4NfBnrK/mCaj28IuLgVS3j/qIcWiUnTJpvcQ+uVs1nHFqCd0jvtrSIQq6p/ff5t/X/f1lnz1UmiXu8t29wfw9LnfbTcubbeJTpTDglgAw9x/hp9/wg==',key_name='tempest-keypair-22406688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='708c7a9d408f4b6e9300246c0bd84f73',ramdisk_id='',reservation_id='r-30ezqyyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-40984610',owner_user_name='tempest-ServerStableDeviceRescueTest-40984610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72961e6dbb884091a9b3fa92da558ef4',uuid=f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converting VIF {"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG os_vif [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05e70318-a786-558c-959f-1d971c8ce309', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2002e939-5f, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2002e939-5f, col_values=(('qos', UUID('f29aa821-ad69-4d95-b714-56315f3b0a9a')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2002e939-5f, col_values=(('external_ids', {'iface-id': '2002e939-5f21-48cf-8aae-7868f7c6992a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:c5:2e', 'vm-uuid': 'f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:43 user nova-compute[74932]: INFO os_vif [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f')
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:35:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No VIF found with MAC fa:16:3e:a1:c5:2e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:35:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updated VIF entry in instance network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:35:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a46f4468-681a-4c13-a289-a2dc8fefb25a req-0aad79e1-0639-4417-9e99-9ae49d364408 service nova] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-f8c19157-99e4-47fe-ac9f-90337d2ad8a5 req-91297aad-ea23-4984-9ca0-27c5cce5d1f0 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f8c19157-99e4-47fe-ac9f-90337d2ad8a5 req-91297aad-ea23-4984-9ca0-27c5cce5d1f0 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f8c19157-99e4-47fe-ac9f-90337d2ad8a5 req-91297aad-ea23-4984-9ca0-27c5cce5d1f0 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f8c19157-99e4-47fe-ac9f-90337d2ad8a5 req-91297aad-ea23-4984-9ca0-27c5cce5d1f0 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG nova.compute.manager [req-f8c19157-99e4-47fe-ac9f-90337d2ad8a5 req-91297aad-ea23-4984-9ca0-27c5cce5d1f0 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:45 user nova-compute[74932]: WARNING nova.compute.manager [req-f8c19157-99e4-47fe-ac9f-90337d2ad8a5 req-91297aad-ea23-4984-9ca0-27c5cce5d1f0 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state building and task_state spawning.
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:35:45 user nova-compute[74932]: INFO nova.compute.manager [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Rescuing
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:35:45 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance destroyed successfully.
Nov 03 16:35:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Attempting rescue
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74932) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:35:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Creating image(s)
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:47 user nova-compute[74932]: WARNING nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state building and task_state spawning.
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:47 user nova-compute[74932]: WARNING nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state active and task_state rescuing.
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:47 user nova-compute[74932]: WARNING nova.compute.manager [req-d51a2d42-616f-4642-a7ad-9cab2c8769fa req-7f8e7720-1b80-4363-9d0e-f626bd8e1c70 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state active and task_state rescuing.
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue" returned: 0 in 0.071s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'migration_context' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.base [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<1ed9acd4-1794-429c-9c37-84a58024947c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Start _get_guest_xml network_info=[{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:28:95:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'resources' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.base [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<1ed9acd4-1794-429c-9c37-84a58024947c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'numa_topology' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.base [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<1ed9acd4-1794-429c-9c37-84a58024947c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:35:47 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:35:47 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.base [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<1ed9acd4-1794-429c-9c37-84a58024947c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2063351239',display_name='tempest-ServerRescueNegativeTestJSON-server-2063351239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2063351239',id=18,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-39nqenhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:31:06Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=1ed9acd4-1794-429c-9c37-84a58024947c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:28:95:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:28:95:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.objects.base [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<1ed9acd4-1794-429c-9c37-84a58024947c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:35:47 user nova-compute[74932]:   <uuid>1ed9acd4-1794-429c-9c37-84a58024947c</uuid>
Nov 03 16:35:47 user nova-compute[74932]:   <name>instance-00000012</name>
Nov 03 16:35:47 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:35:47 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:35:47 user nova-compute[74932]:   <metadata>
Nov 03 16:35:47 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:35:47 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:35:47 user nova-compute[74932]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2063351239</nova:name>
Nov 03 16:35:47 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:35:47</nova:creationTime>
Nov 03 16:35:47 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:35:47 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:35:47 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:35:47 user nova-compute[74932]:       <nova:owner>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:user uuid="462c0b16a5f744e49b3ee3ef8ee39e00">tempest-ServerRescueNegativeTestJSON-1518505179-project-member</nova:user>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:project uuid="dd1f1557f72d4ca1ac1d34772c23a953">tempest-ServerRescueNegativeTestJSON-1518505179</nova:project>
Nov 03 16:35:47 user nova-compute[74932]:       </nova:owner>
Nov 03 16:35:47 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:35:47 user nova-compute[74932]:       <nova:ports>
Nov 03 16:35:47 user nova-compute[74932]:         <nova:port uuid="383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c">
Nov 03 16:35:47 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:35:47 user nova-compute[74932]:         </nova:port>
Nov 03 16:35:47 user nova-compute[74932]:       </nova:ports>
Nov 03 16:35:47 user nova-compute[74932]:     </nova:instance>
Nov 03 16:35:47 user nova-compute[74932]:   </metadata>
Nov 03 16:35:47 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:35:47 user nova-compute[74932]:     <system>
Nov 03 16:35:47 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:35:47 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:35:47 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:35:47 user nova-compute[74932]:       <entry name="serial">1ed9acd4-1794-429c-9c37-84a58024947c</entry>
Nov 03 16:35:47 user nova-compute[74932]:       <entry name="uuid">1ed9acd4-1794-429c-9c37-84a58024947c</entry>
Nov 03 16:35:47 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:35:47 user nova-compute[74932]:     </system>
Nov 03 16:35:47 user nova-compute[74932]:   </sysinfo>
Nov 03 16:35:47 user nova-compute[74932]:   <os>
Nov 03 16:35:47 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:35:47 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:35:47 user nova-compute[74932]:   </os>
Nov 03 16:35:47 user nova-compute[74932]:   <features>
Nov 03 16:35:47 user nova-compute[74932]:     <acpi/>
Nov 03 16:35:47 user nova-compute[74932]:     <apic/>
Nov 03 16:35:47 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:35:47 user nova-compute[74932]:   </features>
Nov 03 16:35:47 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:35:47 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:35:47 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:35:47 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:35:47 user nova-compute[74932]:   </clock>
Nov 03 16:35:47 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:35:47 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:35:47 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:35:47 user nova-compute[74932]:   </cpu>
Nov 03 16:35:47 user nova-compute[74932]:   <devices>
Nov 03 16:35:47 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:35:47 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:35:47 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue"/>
Nov 03 16:35:47 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:35:47 user nova-compute[74932]:     </disk>
Nov 03 16:35:47 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:35:47 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:35:47 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk"/>
Nov 03 16:35:47 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:35:47 user nova-compute[74932]:     </disk>
Nov 03 16:35:47 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:35:47 user nova-compute[74932]:       <mac address="fa:16:3e:28:95:4e"/>
Nov 03 16:35:47 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:35:47 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:35:47 user nova-compute[74932]:       <target dev="tap383bb4bc-f4"/>
Nov 03 16:35:47 user nova-compute[74932]:     </interface>
Nov 03 16:35:47 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:35:47 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/console.log" append="off"/>
Nov 03 16:35:47 user nova-compute[74932]:     </serial>
Nov 03 16:35:47 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:35:47 user nova-compute[74932]:     <video>
Nov 03 16:35:47 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:35:47 user nova-compute[74932]:     </video>
Nov 03 16:35:47 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:35:47 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:35:47 user nova-compute[74932]:     </rng>
Nov 03 16:35:47 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:35:47 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:35:47 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:35:47 user nova-compute[74932]:     </memballoon>
Nov 03 16:35:47 user nova-compute[74932]:   </devices>
Nov 03 16:35:47 user nova-compute[74932]: </domain>
Nov 03 16:35:47 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance spawned successfully.
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:35:47 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance destroyed successfully.
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:35:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:35:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:35:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:28:95:4e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:35:48 user nova-compute[74932]: INFO nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 03 16:35:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:35:48 user nova-compute[74932]: INFO nova.compute.manager [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Took 6.91 seconds to build instance.
Nov 03 16:35:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dfcfb3b-5f63-429a-a0df-64285c685f60 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-d45ba441-50d2-4ddf-94d9-261f3df93459 req-e5d89db1-5cda-4c81-b2b0-c9f7dc9fdd9c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d45ba441-50d2-4ddf-94d9-261f3df93459 req-e5d89db1-5cda-4c81-b2b0-c9f7dc9fdd9c service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d45ba441-50d2-4ddf-94d9-261f3df93459 req-e5d89db1-5cda-4c81-b2b0-c9f7dc9fdd9c service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d45ba441-50d2-4ddf-94d9-261f3df93459 req-e5d89db1-5cda-4c81-b2b0-c9f7dc9fdd9c service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-d45ba441-50d2-4ddf-94d9-261f3df93459 req-e5d89db1-5cda-4c81-b2b0-c9f7dc9fdd9c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:49 user nova-compute[74932]: WARNING nova.compute.manager [req-d45ba441-50d2-4ddf-94d9-261f3df93459 req-e5d89db1-5cda-4c81-b2b0-c9f7dc9fdd9c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state active and task_state rescuing.
Nov 03 16:35:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:35:51 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4f14e8f3-714e-4a86-bdf4-fcbd8332f41a tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:35:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-5d5a91ec-dad9-45b6-9183-06af61cca217 req-f3c02d10-0fe1-4fde-be0f-1f15ac53bac3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:35:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5d5a91ec-dad9-45b6-9183-06af61cca217 req-f3c02d10-0fe1-4fde-be0f-1f15ac53bac3 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5d5a91ec-dad9-45b6-9183-06af61cca217 req-f3c02d10-0fe1-4fde-be0f-1f15ac53bac3 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5d5a91ec-dad9-45b6-9183-06af61cca217 req-f3c02d10-0fe1-4fde-be0f-1f15ac53bac3 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-5d5a91ec-dad9-45b6-9183-06af61cca217 req-f3c02d10-0fe1-4fde-be0f-1f15ac53bac3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:35:51 user nova-compute[74932]: WARNING nova.compute.manager [req-5d5a91ec-dad9-45b6-9183-06af61cca217 req-f3c02d10-0fe1-4fde-be0f-1f15ac53bac3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state rescued and task_state None.
Nov 03 16:35:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OskrJTzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:35:58 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:35:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:35:58 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:35:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:35:58 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c678db-b6da-47f7-844d-a83ae2cf7716]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:35:58 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae9b264-633c-42da-a970-df69eb7cb5b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c] added
Nov 03 16:35:59 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e15c6e-f82e-49e3-94b6-49a1bcfc4c6f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78323004-eb3a-48e0-bd2f-0f4ac799678f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OskrJTzV {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OskrJTzV" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f7b28d-beda-4030-884d-df1819d1c83e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OskrJTzV'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e5b4d-1829-459a-93e8-ac8311c3ce7a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[017b8521-700e-4d94-925e-214a2f2a46c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:35:59 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:35:59 user nova-compute[74932]:  {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:35:59 user nova-compute[74932]: WARNING os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 16:35:59 user nova-compute[74932]: 
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ec2e6-3a41-4291-9c45-f3ab5f488b99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260]
Nov 03 16:35:59 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260] successful.
Nov 03 16:35:59 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8241d69a-48db-4837-8145-135a624a900a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c20f9-5754-485b-91f9-900532b77eca]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c (non-flash)
Nov 03 16:35:59 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c (non-flash)
Nov 03 16:35:59 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[721958c2-a265-4c40-bcff-fdcd6893bbdc]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:35:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:00 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:36:00 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=25.26105499267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 358b33c3-c1e4-4f79-a5e0-0b60b9205339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5aa105d4-e07c-48aa-8931-528c4c924e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OskrJTzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23166653262343162', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166653262343162', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.objects.instance [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'flavor' on Instance uuid ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:36:00 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:36:00 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:36:00 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:36:00 user nova-compute[74932]:   <serial>73aaf629-ae27-467d-b367-d2240a6b890c</serial>
Nov 03 16:36:00 user nova-compute[74932]: </disk>
Nov 03 16:36:00 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:36:00 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No VIF found with MAC fa:16:3e:af:a5:76, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:36:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-42fdb11a-14e1-4f11-a4d9-650c79ca6465 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.928s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:03 user nova-compute[74932]: INFO nova.compute.manager [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Detaching volume 73aaf629-ae27-467d-b367-d2240a6b890c
Nov 03 16:36:03 user nova-compute[74932]: INFO nova.virt.block_device [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Attempting to driver detach volume 73aaf629-ae27-467d-b367-d2240a6b890c from mountpoint /dev/vdb
Nov 03 16:36:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Attempting to detach device vdb from instance ad86cdd7-1253-4246-ac62-32c4898b30df from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:36:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:36:03 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:36:03 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:36:03 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:36:03 user nova-compute[74932]:   <serial>73aaf629-ae27-467d-b367-d2240a6b890c</serial>
Nov 03 16:36:03 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:36:03 user nova-compute[74932]: </disk>
Nov 03 16:36:03 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:36:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:03 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully detached device vdb from instance ad86cdd7-1253-4246-ac62-32c4898b30df from the persistent domain config.
Nov 03 16:36:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad86cdd7-1253-4246-ac62-32c4898b30df from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:36:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:36:03 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:36:03 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:36:03 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:36:03 user nova-compute[74932]:   <serial>73aaf629-ae27-467d-b367-d2240a6b890c</serial>
Nov 03 16:36:03 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:36:03 user nova-compute[74932]: </disk>
Nov 03 16:36:03 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:36:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:36:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:36:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:36:06 user nova-compute[74932]: INFO nova.compute.claims [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Claim successful on node user
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:36:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.policy [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55c678331ab147d8970f06830f55853b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '660be27a2adc4e15b5585a9d90bb5d8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:36:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Creating image(s)
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "/opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "/opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "/opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.212s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk 1073741824" returned: 0 in 0.128s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.217s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Successfully created port: 5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Cannot resize image /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Successfully updated port: 5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "refresh_cache-262ac79d-1bdf-4357-af63-0e6b98fa5b5f" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquired lock "refresh_cache-262ac79d-1bdf-4357-af63-0e6b98fa5b5f" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-changed-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Refreshing instance network info cache due to event network-changed-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] Acquiring lock "refresh_cache-262ac79d-1bdf-4357-af63-0e6b98fa5b5f" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Updating instance_info_cache with network_info: [{"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Releasing lock "refresh_cache-262ac79d-1bdf-4357-af63-0e6b98fa5b5f" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Instance network_info: |[{"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] Acquired lock "refresh_cache-262ac79d-1bdf-4357-af63-0e6b98fa5b5f" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.neutron [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Refreshing network info cache for port 5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Start _get_guest_xml network_info=[{"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:36:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:36:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-178882574',display_name='tempest-VolumesActionsTest-instance-178882574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-178882574',id=28,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='660be27a2adc4e15b5585a9d90bb5d8a',ramdisk_id='',reservation_id='r-m4jguxre',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-453500561',owner_user_name='tempest-VolumesActionsTest-453500561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:36:08Z,user_data=None,user_id='55c678331ab147d8970f06830f55853b',uuid=262ac79d-1bdf-4357-af63-0e6b98fa5b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converting VIF {"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lazy-loading 'pci_devices' on Instance uuid 262ac79d-1bdf-4357-af63-0e6b98fa5b5f {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:36:09 user nova-compute[74932]:   <uuid>262ac79d-1bdf-4357-af63-0e6b98fa5b5f</uuid>
Nov 03 16:36:09 user nova-compute[74932]:   <name>instance-0000001c</name>
Nov 03 16:36:09 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:36:09 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:36:09 user nova-compute[74932]:   <metadata>
Nov 03 16:36:09 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:36:09 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:36:09 user nova-compute[74932]:       <nova:name>tempest-VolumesActionsTest-instance-178882574</nova:name>
Nov 03 16:36:09 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:36:09</nova:creationTime>
Nov 03 16:36:09 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:36:09 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:36:09 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:36:09 user nova-compute[74932]:       <nova:owner>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:user uuid="55c678331ab147d8970f06830f55853b">tempest-VolumesActionsTest-453500561-project-member</nova:user>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:project uuid="660be27a2adc4e15b5585a9d90bb5d8a">tempest-VolumesActionsTest-453500561</nova:project>
Nov 03 16:36:09 user nova-compute[74932]:       </nova:owner>
Nov 03 16:36:09 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:36:09 user nova-compute[74932]:       <nova:ports>
Nov 03 16:36:09 user nova-compute[74932]:         <nova:port uuid="5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8">
Nov 03 16:36:09 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 16:36:09 user nova-compute[74932]:         </nova:port>
Nov 03 16:36:09 user nova-compute[74932]:       </nova:ports>
Nov 03 16:36:09 user nova-compute[74932]:     </nova:instance>
Nov 03 16:36:09 user nova-compute[74932]:   </metadata>
Nov 03 16:36:09 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:36:09 user nova-compute[74932]:     <system>
Nov 03 16:36:09 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:36:09 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:36:09 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:36:09 user nova-compute[74932]:       <entry name="serial">262ac79d-1bdf-4357-af63-0e6b98fa5b5f</entry>
Nov 03 16:36:09 user nova-compute[74932]:       <entry name="uuid">262ac79d-1bdf-4357-af63-0e6b98fa5b5f</entry>
Nov 03 16:36:09 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:36:09 user nova-compute[74932]:     </system>
Nov 03 16:36:09 user nova-compute[74932]:   </sysinfo>
Nov 03 16:36:09 user nova-compute[74932]:   <os>
Nov 03 16:36:09 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:36:09 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:36:09 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:36:09 user nova-compute[74932]:   </os>
Nov 03 16:36:09 user nova-compute[74932]:   <features>
Nov 03 16:36:09 user nova-compute[74932]:     <acpi/>
Nov 03 16:36:09 user nova-compute[74932]:     <apic/>
Nov 03 16:36:09 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:36:09 user nova-compute[74932]:   </features>
Nov 03 16:36:09 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:36:09 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:36:09 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:36:09 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:36:09 user nova-compute[74932]:   </clock>
Nov 03 16:36:09 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:36:09 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:36:09 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:36:09 user nova-compute[74932]:   </cpu>
Nov 03 16:36:09 user nova-compute[74932]:   <devices>
Nov 03 16:36:09 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:36:09 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:36:09 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk"/>
Nov 03 16:36:09 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:36:09 user nova-compute[74932]:     </disk>
Nov 03 16:36:09 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:36:09 user nova-compute[74932]:       <mac address="fa:16:3e:ad:47:54"/>
Nov 03 16:36:09 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:36:09 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:36:09 user nova-compute[74932]:       <target dev="tap5cb4fe0c-7d"/>
Nov 03 16:36:09 user nova-compute[74932]:     </interface>
Nov 03 16:36:09 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:36:09 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/console.log" append="off"/>
Nov 03 16:36:09 user nova-compute[74932]:     </serial>
Nov 03 16:36:09 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:36:09 user nova-compute[74932]:     <video>
Nov 03 16:36:09 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:36:09 user nova-compute[74932]:     </video>
Nov 03 16:36:09 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:36:09 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:36:09 user nova-compute[74932]:     </rng>
Nov 03 16:36:09 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:36:09 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:36:09 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:36:09 user nova-compute[74932]:     </memballoon>
Nov 03 16:36:09 user nova-compute[74932]:   </devices>
Nov 03 16:36:09 user nova-compute[74932]: </domain>
Nov 03 16:36:09 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-178882574',display_name='tempest-VolumesActionsTest-instance-178882574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-178882574',id=28,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='660be27a2adc4e15b5585a9d90bb5d8a',ramdisk_id='',reservation_id='r-m4jguxre',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-453500561',owner_user_name='tempest-VolumesActionsTest-453500561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:36:08Z,user_data=None,user_id='55c678331ab147d8970f06830f55853b',uuid=262ac79d-1bdf-4357-af63-0e6b98fa5b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converting VIF {"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG os_vif [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43d98876-204a-5362-98e4-7511c8590f62', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cb4fe0c-7d, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cb4fe0c-7d, col_values=(('qos', UUID('87da31e0-2760-4f35-9b11-865d811fb5f4')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cb4fe0c-7d, col_values=(('external_ids', {'iface-id': '5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:47:54', 'vm-uuid': '262ac79d-1bdf-4357-af63-0e6b98fa5b5f'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:09 user nova-compute[74932]: INFO os_vif [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d')
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:36:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] No VIF found with MAC fa:16:3e:ad:47:54, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:36:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Updated VIF entry in instance network info cache for port 5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:36:10 user nova-compute[74932]: DEBUG nova.network.neutron [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Updating instance_info_cache with network_info: [{"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:36:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3a736494-3db7-4b21-b05c-749544266915 req-c11bfa48-8bb1-4790-9152-df925a23faa9 service nova] Releasing lock "refresh_cache-262ac79d-1bdf-4357-af63-0e6b98fa5b5f" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ac63b8ef-e5b4-499f-923c-e015a5bd9554 req-be359620-7f73-4993-b396-57952f4fc288 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ac63b8ef-e5b4-499f-923c-e015a5bd9554 req-be359620-7f73-4993-b396-57952f4fc288 service nova] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ac63b8ef-e5b4-499f-923c-e015a5bd9554 req-be359620-7f73-4993-b396-57952f4fc288 service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ac63b8ef-e5b4-499f-923c-e015a5bd9554 req-be359620-7f73-4993-b396-57952f4fc288 service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ac63b8ef-e5b4-499f-923c-e015a5bd9554 req-be359620-7f73-4993-b396-57952f4fc288 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] No waiting events found dispatching network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:36:11 user nova-compute[74932]: WARNING nova.compute.manager [req-ac63b8ef-e5b4-499f-923c-e015a5bd9554 req-be359620-7f73-4993-b396-57952f4fc288 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received unexpected event network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 for instance with vm_state building and task_state spawning.
Nov 03 16:36:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-768d020d-bb56-4145-86ed-ed977a921e68 req-6dcbff25-5279-4325-acfc-d12b4d5a2a75 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-768d020d-bb56-4145-86ed-ed977a921e68 req-6dcbff25-5279-4325-acfc-d12b4d5a2a75 service nova] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-768d020d-bb56-4145-86ed-ed977a921e68 req-6dcbff25-5279-4325-acfc-d12b4d5a2a75 service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-768d020d-bb56-4145-86ed-ed977a921e68 req-6dcbff25-5279-4325-acfc-d12b4d5a2a75 service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-768d020d-bb56-4145-86ed-ed977a921e68 req-6dcbff25-5279-4325-acfc-d12b4d5a2a75 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] No waiting events found dispatching network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:36:13 user nova-compute[74932]: WARNING nova.compute.manager [req-768d020d-bb56-4145-86ed-ed977a921e68 req-6dcbff25-5279-4325-acfc-d12b4d5a2a75 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received unexpected event network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 for instance with vm_state building and task_state spawning.
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:36:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Instance spawned successfully.
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:36:13 user nova-compute[74932]: INFO nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 03 16:36:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:36:13 user nova-compute[74932]: INFO nova.compute.manager [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Took 6.91 seconds to build instance.
Nov 03 16:36:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f3b8ab46-4369-4d3e-b96c-c86f4b564c45 tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.023s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG nova.compute.manager [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-changed-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG nova.compute.manager [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Refreshing instance network info cache due to event network-changed-59260b8c-b47c-461e-bd16-cc0f8ad3b33e. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] Acquiring lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] Acquired lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG nova.network.neutron [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Refreshing network info cache for port 59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG nova.network.neutron [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updated VIF entry in instance network info cache for port 59260b8c-b47c-461e-bd16-cc0f8ad3b33e. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG nova.network.neutron [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updating instance_info_cache with network_info: [{"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:36:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-243213f8-6d9e-4836-a322-1fee8e971629 req-ea298e43-ded1-4ffd-8a30-ebba26bb83f2 service nova] Releasing lock "refresh_cache-96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:36:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad86cdd7-1253-4246-ac62-32c4898b30df is timed out.
Nov 03 16:36:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully detached device vdb from instance ad86cdd7-1253-4246-ac62-32c4898b30df from the live domain config.
Nov 03 16:36:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OskrJTzV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:36:24 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a05b7-8960-4450-9003-c1cbbd20a55f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:36:24 user nova-compute[74932]: No targets found.
Nov 03 16:36:24 user nova-compute[74932]: iSNS:
Nov 03 16:36:24 user nova-compute[74932]: No targets found.
Nov 03 16:36:24 user nova-compute[74932]: STATIC:
Nov 03 16:36:24 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c
Nov 03 16:36:24 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:36:24 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:36:24 user nova-compute[74932]: FIRMWARE:
Nov 03 16:36:24 user nova-compute[74932]: No targets found.
Nov 03 16:36:24 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:36:24 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:36:24 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0572d8e-8f2f-4c50-b5e3-22317101b9ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea3219-287f-485e-bdb2-b1653263efbf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c (non-flash)
Nov 03 16:36:24 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c (non-flash)
Nov 03 16:36:24 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6432a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c988d99b-ca2d-495c-b268-f8de5ca8decf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed8f528-7313-41ed-ba80-2b658b606d18]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4680f55-4426-4259-afa5-c34570455dbd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7e857-d5a0-4eec-8142-73850bbcc54a]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cf2942-cdfb-42c3-8c21-17cf4921d266]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0afb42-6a3a-4fb8-b839-22713a725aa6]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260]
Nov 03 16:36:24 user nova-compute[74932]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c, portal: 172.16.0.220,3260] successful.
Nov 03 16:36:24 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aaf629-ae27-467d-b367-d2240a6b890c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05b2ff2-dd0f-4fa3-bc8b-602cfc48f79e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] <== disconnect_volume: return (298ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:36:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:26 user nova-compute[74932]: INFO nova.compute.manager [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Terminating instance
Nov 03 16:36:26 user nova-compute[74932]: DEBUG nova.compute.manager [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-80134ebd-ccc6-4cc7-b9ea-897848a70e54 req-f946b8be-5b2d-4699-80d9-7defd006d5ba service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-unplugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-80134ebd-ccc6-4cc7-b9ea-897848a70e54 req-f946b8be-5b2d-4699-80d9-7defd006d5ba service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-80134ebd-ccc6-4cc7-b9ea-897848a70e54 req-f946b8be-5b2d-4699-80d9-7defd006d5ba service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-80134ebd-ccc6-4cc7-b9ea-897848a70e54 req-f946b8be-5b2d-4699-80d9-7defd006d5ba service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-80134ebd-ccc6-4cc7-b9ea-897848a70e54 req-f946b8be-5b2d-4699-80d9-7defd006d5ba service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-unplugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-80134ebd-ccc6-4cc7-b9ea-897848a70e54 req-f946b8be-5b2d-4699-80d9-7defd006d5ba service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-unplugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:36:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Instance destroyed successfully.
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.objects.instance [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lazy-loading 'resources' on Instance uuid 358b33c3-c1e4-4f79-a5e0-0b60b9205339 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1768994889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1768994889',id=17,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMg74tpn1Jh2l3/7bwzbGi29wVQa00Lqdj4LoxlzHfDbzcXqn3iwMNhc9A5CxZx3hemUyqu+0fxA7FI9X4Jgw+Z5OuNrS2thzUQ/YToMjxpJ1BNU/iHRky+89bhEdyD5g==',key_name='tempest-keypair-360156465',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b101d0f7f99a41f699e3f2701cc35248',ramdisk_id='',reservation_id='r-oyk2eyi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1586732873',owner_user_name='tempest-AttachVolumeShelveTestJSON-1586732873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd49e83fa0846d191cb4cf0719ba038',uuid=358b33c3-c1e4-4f79-a5e0-0b60b9205339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converting VIF {"id": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "address": "fa:16:3e:90:ff:74", "network": {"id": "31e0b154-d670-4fdc-b179-f37c6bf39841", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1475028057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b101d0f7f99a41f699e3f2701cc35248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd809cace-ae", "ovs_interfaceid": "d809cace-ae35-4d72-83fb-e0e4a83ea558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG os_vif [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd809cace-ae, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff2b3ee1-561a-4db7-8592-9038ac6a03ca) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:27 user nova-compute[74932]: INFO os_vif [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ff:74,bridge_name='br-int',has_traffic_filtering=True,id=d809cace-ae35-4d72-83fb-e0e4a83ea558,network=Network(31e0b154-d670-4fdc-b179-f37c6bf39841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd809cace-ae')
Nov 03 16:36:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Deleting instance files /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339_del
Nov 03 16:36:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Deletion of /opt/stack/data/nova/instances/358b33c3-c1e4-4f79-a5e0-0b60b9205339_del complete
Nov 03 16:36:27 user nova-compute[74932]: INFO nova.compute.manager [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 16:36:27 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:36:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:36:28 user nova-compute[74932]: INFO nova.compute.manager [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] instance snapshotting
Nov 03 16:36:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Beginning live snapshot process
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:36:28 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Took 0.93 seconds to deallocate network for instance.
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl2wkuv1j/51a738dfb7a648d4aec9017bac34a5b3.delta 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl2wkuv1j/51a738dfb7a648d4aec9017bac34a5b3.delta 1073741824" returned: 0 in 0.066s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:29 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 16:36:29 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG nova.compute.manager [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] Acquiring lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG nova.compute.manager [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] No waiting events found dispatching network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:36:29 user nova-compute[74932]: WARNING nova.compute.manager [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received unexpected event network-vif-plugged-d809cace-ae35-4d72-83fb-e0e4a83ea558 for instance with vm_state deleted and task_state None.
Nov 03 16:36:29 user nova-compute[74932]: DEBUG nova.compute.manager [req-7587322e-db95-4d62-8891-e319c13f9b20 req-27ba757c-d934-469c-b6fb-e33f09c5719e service nova] [instance: 358b33c3-c1e4-4f79-a5e0-0b60b9205339] Received event network-vif-deleted-d809cace-ae35-4d72-83fb-e0e4a83ea558 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:29 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Deleted allocations for instance 358b33c3-c1e4-4f79-a5e0-0b60b9205339
Nov 03 16:36:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-73e92615-0f48-4066-ac0e-eba27e51afe4 tempest-AttachVolumeShelveTestJSON-1586732873 tempest-AttachVolumeShelveTestJSON-1586732873-project-member] Lock "358b33c3-c1e4-4f79-a5e0-0b60b9205339" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.617s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:36:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:36:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 16:36:30 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:36:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl2wkuv1j/51a738dfb7a648d4aec9017bac34a5b3.delta /opt/stack/data/nova/instances/snapshots/tmpl2wkuv1j/51a738dfb7a648d4aec9017bac34a5b3 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl2wkuv1j/51a738dfb7a648d4aec9017bac34a5b3.delta /opt/stack/data/nova/instances/snapshots/tmpl2wkuv1j/51a738dfb7a648d4aec9017bac34a5b3" returned: 0 in 0.705s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:31 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Snapshot extracted, beginning image upload
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:31 user nova-compute[74932]: INFO nova.compute.manager [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Attaching volume 8bc37210-8e1e-47af-ad94-67232b4b8d06 to /dev/vdb
Nov 03 16:36:31 user nova-compute[74932]: DEBUG os_brick.utils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90e9b7-9926-4490-8cad-cc81ba30dc2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eee871b-401e-449a-96e7-062618c433e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[555c22ed-3ee6-4a2a-934f-5834b439caf8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee600b83-7536-45ea-8266-fb171bead854]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:36:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:36:32 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:36:32 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0121e1-0c12-4427-93bd-c6a21da01644]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG os_brick.utils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updating existing volume attachment record: 6958561e-16d0-483f-a294-e82cdbccdabe {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:34 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Snapshot image upload complete
Nov 03 16:36:34 user nova-compute[74932]: INFO nova.compute.manager [None req-5d8f2826-bb6a-4d28-b122-927125416858 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Took 6.56 seconds to snapshot the instance on the hypervisor.
Nov 03 16:36:35 user nova-compute[74932]: DEBUG nova.objects.instance [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'flavor' on Instance uuid ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:36:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0c981470-b4fc-4489-8fac-94a60466b442 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.344s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:36:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:36:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:36:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-changed-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Refreshing instance network info cache due to event network-changed-ce1737f3-6745-49e5-89de-7cd37dac064b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] Acquiring lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] Acquired lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Refreshing network info cache for port ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.network.neutron [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updated VIF entry in instance network info cache for port ce1737f3-6745-49e5-89de-7cd37dac064b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.network.neutron [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updating instance_info_cache with network_info: [{"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d2d8cc4f-d564-4a88-88f9-5c8548aa4a1e req-0d394f02-2885-418b-a0c7-a8eaefb4c0cd service nova] Releasing lock "refresh_cache-5aa105d4-e07c-48aa-8931-528c4c924e03" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:36:59 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:36:59 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7455MB free_disk=25.172283172607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5aa105d4-e07c-48aa-8931-528c4c924e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 262ac79d-1bdf-4357-af63-0e6b98fa5b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'flavor' on Instance uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:36:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:00 user nova-compute[74932]: INFO nova.compute.manager [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attaching volume a96b913e-a89b-49e2-9cdd-9707f2c99d5e to /dev/vdb
Nov 03 16:37:00 user nova-compute[74932]: DEBUG os_brick.utils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a446bf-cb5e-47b7-abd8-8a6bbcd01c4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[98590ac5-1572-4c42-8e09-5042f250070b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b08b5-dbc8-42af-b7e2-2bb47bebc610]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7843123-0500-4590-beda-d1c68083c4f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:37:00 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:37:00 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[536dd542-3074-4605-8be5-9a777f45b0b2]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG os_brick.utils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:00 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updating existing volume attachment record: 5ac44bfa-afb5-4f07-8594-904a1fe6e382 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:37:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:37:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CryUcNgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:12 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:12 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:12 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[171d6a88-76f8-479b-a482-bcf553ad71d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:37:12 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae21ae-7630-4994-9628-8807a13cc72d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06] added
Nov 03 16:37:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f35b2-4d6b-4e5d-a60f-759be614dfd2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d9709-3399-4d78-8b62-cbf4078a8f73]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CryUcNgn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CryUcNgn" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad971b83-cb98-4cc8-863c-43b56980d51b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CryUcNgn'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7da0da-4472-4271-a13b-3d9923b12553]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b7c3d2-dd4d-4003-8523-596dbde7f155]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:37:12 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:37:12 user nova-compute[74932]:  {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:12 user nova-compute[74932]: WARNING os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 16:37:12 user nova-compute[74932]: 
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0201537-d017-4985-986f-7e5da62e6485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260]
Nov 03 16:37:12 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260] successful.
Nov 03 16:37:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b337b-7747-4263-ba00-36dd06285500]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d72acb-77ec-4992-8c28-829dbfaa948e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de809f9-f5c4-408b-b921-ea8a02db7e6a]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:37:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CryUcNgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23231336466393665', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231336466393665', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:37:14 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:37:14 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:37:14 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:37:14 user nova-compute[74932]:   <serial>8bc37210-8e1e-47af-ad94-67232b4b8d06</serial>
Nov 03 16:37:14 user nova-compute[74932]: </disk>
Nov 03 16:37:14 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No VIF found with MAC fa:16:3e:6d:45:f8, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:37:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f062cc61-23d1-43ba-b814-031f90fda235 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.834s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:37:15 user nova-compute[74932]: INFO nova.compute.manager [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] instance snapshotting
Nov 03 16:37:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Beginning live snapshot process
Nov 03 16:37:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:16 user nova-compute[74932]: INFO nova.compute.manager [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Detaching volume 8bc37210-8e1e-47af-ad94-67232b4b8d06
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7_yqvl8l/1ce25fe056744982ba7cac7b2950477b.delta 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:16 user nova-compute[74932]: INFO nova.virt.block_device [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Attempting to driver detach volume 8bc37210-8e1e-47af-ad94-67232b4b8d06 from mountpoint /dev/vdb
Nov 03 16:37:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7_yqvl8l/1ce25fe056744982ba7cac7b2950477b.delta 1073741824" returned: 0 in 0.092s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 16:37:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Attempting to detach device vdb from instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:37:16 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:37:16 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:37:16 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:37:16 user nova-compute[74932]:   <serial>8bc37210-8e1e-47af-ad94-67232b4b8d06</serial>
Nov 03 16:37:16 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:37:16 user nova-compute[74932]: </disk>
Nov 03 16:37:16 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:37:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully detached device vdb from instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 from the persistent domain config.
Nov 03 16:37:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:37:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:37:16 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:37:16 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:37:16 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:37:16 user nova-compute[74932]:   <serial>8bc37210-8e1e-47af-ad94-67232b4b8d06</serial>
Nov 03 16:37:16 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:37:16 user nova-compute[74932]: </disk>
Nov 03 16:37:16 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:37:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:37:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:37:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:37:17 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 16:37:17 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:37:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7_yqvl8l/1ce25fe056744982ba7cac7b2950477b.delta /opt/stack/data/nova/instances/snapshots/tmp7_yqvl8l/1ce25fe056744982ba7cac7b2950477b {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7_yqvl8l/1ce25fe056744982ba7cac7b2950477b.delta /opt/stack/data/nova/instances/snapshots/tmp7_yqvl8l/1ce25fe056744982ba7cac7b2950477b" returned: 0 in 0.467s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:18 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Snapshot extracted, beginning image upload
Nov 03 16:37:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Snapshot image upload complete
Nov 03 16:37:21 user nova-compute[74932]: INFO nova.compute.manager [None req-28f88f39-85ee-4a45-b29f-10f855bc81c3 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Took 5.89 seconds to snapshot the instance on the hypervisor.
Nov 03 16:37:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:21 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:21 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:21 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d6d5e2-2048-4ffe-ad4e-0a6301161b9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:37:21 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[176aa14e-070e-4c82-abe8-1c71c9c5c603]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e] added
Nov 03 16:37:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3816f5ff-2f72-4968-85ca-8c8653b9bcec]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b1faa3-1f4a-4e10-ad41-4e987122ab8f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVxPOtbC {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVxPOtbC" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e37034-7203-4c49-a5a5-647c9e32b808]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVxPOtbC'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d3a66-beca-4b36-a35b-b1bcca59dc77]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b0032-bf5f-429c-8576-1cc7c00e095c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f46673e-ff06-4c06-95f8-2c11ba925660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]
Nov 03 16:37:21 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.
Nov 03 16:37:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe368b2-b31e-4619-a020-92e14433fdc7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efd5cf0-a981-4bff-aa74-d56056f486ca]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:22 user nova-compute[74932]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:37:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:22 user nova-compute[74932]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:37:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23620ec-9dc0-492f-8dbf-10f92d2ad1e4]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:37:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23238303265633637', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238303265633637', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.objects.instance [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'flavor' on Instance uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:37:23 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:37:23 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:37:23 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:37:23 user nova-compute[74932]:   <serial>a96b913e-a89b-49e2-9cdd-9707f2c99d5e</serial>
Nov 03 16:37:23 user nova-compute[74932]: </disk>
Nov 03 16:37:23 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:37:23 user nova-compute[74932]: INFO nova.compute.claims [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Claim successful on node user
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No VIF found with MAC fa:16:3e:48:58:95, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-039b7cde-76d8-467f-a124-99f5df80e8e1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.553s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:37:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:37:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:37:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG nova.policy [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99403819bf9845ac85cf9ff73a492507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c887cbc267d40dd9e270a25f6baf66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:37:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Creating image(s)
Nov 03 16:37:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "/opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "/opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "/opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.part --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG nova.virt.images [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] b37f05e8-bf67-4229-8ba8-4fb65b55423a was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.part /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.part /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.converted" returned: 0 in 0.320s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.533s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79 --force-share --output=json" returned: 0 in 0.212s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:25 user nova-compute[74932]: INFO nova.compute.manager [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Rebuilding instance
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.network.neutron [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Successfully created port: 8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79 --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79,backing_fmt=raw /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79,backing_fmt=raw /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk 1073741824" returned: 0 in 0.055s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7f0d01b8f1fcc8ed6ada017ca99bb07e0605c79 --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Ensure instance console log exists: /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-b2df6b3e-6c7f-4df1-b8d3-66a09210046f req-592ce0b2-d770-4166-93db-a960534fa409 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-unplugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b2df6b3e-6c7f-4df1-b8d3-66a09210046f req-592ce0b2-d770-4166-93db-a960534fa409 service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b2df6b3e-6c7f-4df1-b8d3-66a09210046f req-592ce0b2-d770-4166-93db-a960534fa409 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b2df6b3e-6c7f-4df1-b8d3-66a09210046f req-592ce0b2-d770-4166-93db-a960534fa409 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-b2df6b3e-6c7f-4df1-b8d3-66a09210046f req-592ce0b2-d770-4166-93db-a960534fa409 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-unplugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:26 user nova-compute[74932]: WARNING nova.compute.manager [req-b2df6b3e-6c7f-4df1-b8d3-66a09210046f req-592ce0b2-d770-4166-93db-a960534fa409 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-unplugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state active and task_state rebuilding.
Nov 03 16:37:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.network.neutron [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Successfully updated port: 8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquired lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.network.neutron [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-changed-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Refreshing instance network info cache due to event network-changed-8f16a496-af41-465a-a478-f5c6f43381c1. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] Acquiring lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:26 user nova-compute[74932]: DEBUG nova.network.neutron [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance destroyed successfully.
Nov 03 16:37:27 user nova-compute[74932]: INFO nova.compute.manager [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Detaching volume a96b913e-a89b-49e2-9cdd-9707f2c99d5e
Nov 03 16:37:27 user nova-compute[74932]: INFO nova.virt.block_device [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attempting to driver detach volume a96b913e-a89b-49e2-9cdd-9707f2c99d5e from mountpoint /dev/vdb
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.neutron [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updating instance_info_cache with network_info: [{"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Attempting to detach device vdb from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:37:27 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:37:27 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:37:27 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:37:27 user nova-compute[74932]:   <serial>a96b913e-a89b-49e2-9cdd-9707f2c99d5e</serial>
Nov 03 16:37:27 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:37:27 user nova-compute[74932]: </disk>
Nov 03 16:37:27 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Releasing lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Instance network_info: |[{"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] Acquired lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.neutron [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Refreshing network info cache for port 8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Start _get_guest_xml network_info=[{"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b28e0f5225494525fd9b3c2b76f7ca9e',container_format='bare',created_at=2023-11-03T16:37:15Z,direct_url=<?>,disk_format='qcow2',id=b37f05e8-bf67-4229-8ba8-4fb65b55423a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-57462076',owner='2c887cbc267d40dd9e270a25f6baf66f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T16:37:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'b37f05e8-bf67-4229-8ba8-4fb65b55423a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:37:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully detached device vdb from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 from the persistent domain config.
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:27 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:37:27 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b28e0f5225494525fd9b3c2b76f7ca9e',container_format='bare',created_at=2023-11-03T16:37:15Z,direct_url=<?>,disk_format='qcow2',id=b37f05e8-bf67-4229-8ba8-4fb65b55423a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-57462076',owner='2c887cbc267d40dd9e270a25f6baf66f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T16:37:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-201867260',display_name='tempest-TestStampPattern-server-201867260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-201867260',id=29,image_ref='b37f05e8-bf67-4229-8ba8-4fb65b55423a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMj9AIFIKO0NgK0zkHn0Jy+l3mgfcxgiBUpQw/9Yol77VWUT8u3eYfCI0rb+RgkX7v+WG5SHkNUka8piM/z+1zFyCPRyze8JQydhtJPBVujfoF47Ahsa+Vb6gz5xkxMaw==',key_name='tempest-TestStampPattern-1337686481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c887cbc267d40dd9e270a25f6baf66f',ramdisk_id='',reservation_id='r-8z9m5rip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ad86cdd7-1253-4246-ac62-32c4898b30df',image_min_disk='1',image_min_ram='0',image_owner_id='2c887cbc267d40dd9e270a25f6baf66f',image_owner_project_name='tempest-TestStampPattern-1606523677',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1606523677-project-member',image_user_id='99403819bf9845ac85cf9ff73a492507',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606523677',owner_user_name='tempest-TestStampPattern-1606523677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:24Z,user_data=None,user_id='99403819bf9845ac85cf9ff73a492507',uuid=840e5d07-c2f2-40b3-b05a-23bd8acf56bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converting VIF {"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.objects.instance [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'pci_devices' on Instance uuid 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9307c-2977-4def-ae8d-1419502fd697]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:37:27 user nova-compute[74932]: No targets found.
Nov 03 16:37:27 user nova-compute[74932]: iSNS:
Nov 03 16:37:27 user nova-compute[74932]: No targets found.
Nov 03 16:37:27 user nova-compute[74932]: STATIC:
Nov 03 16:37:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e
Nov 03 16:37:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:37:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:37:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06
Nov 03 16:37:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:37:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:37:27 user nova-compute[74932]: FIRMWARE:
Nov 03 16:37:27 user nova-compute[74932]: No targets found.
Nov 03 16:37:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:37:27 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:37:27 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:37:27 user nova-compute[74932]:   <uuid>840e5d07-c2f2-40b3-b05a-23bd8acf56bd</uuid>
Nov 03 16:37:27 user nova-compute[74932]:   <name>instance-0000001d</name>
Nov 03 16:37:27 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:37:27 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:37:27 user nova-compute[74932]:   <metadata>
Nov 03 16:37:27 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:37:27 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:37:27 user nova-compute[74932]:       <nova:name>tempest-TestStampPattern-server-201867260</nova:name>
Nov 03 16:37:27 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:37:27</nova:creationTime>
Nov 03 16:37:27 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:37:27 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:37:27 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:37:27 user nova-compute[74932]:       <nova:owner>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:user uuid="99403819bf9845ac85cf9ff73a492507">tempest-TestStampPattern-1606523677-project-member</nova:user>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:project uuid="2c887cbc267d40dd9e270a25f6baf66f">tempest-TestStampPattern-1606523677</nova:project>
Nov 03 16:37:27 user nova-compute[74932]:       </nova:owner>
Nov 03 16:37:27 user nova-compute[74932]:       <nova:root type="image" uuid="b37f05e8-bf67-4229-8ba8-4fb65b55423a"/>
Nov 03 16:37:27 user nova-compute[74932]:       <nova:ports>
Nov 03 16:37:27 user nova-compute[74932]:         <nova:port uuid="8f16a496-af41-465a-a478-f5c6f43381c1">
Nov 03 16:37:27 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 16:37:27 user nova-compute[74932]:         </nova:port>
Nov 03 16:37:27 user nova-compute[74932]:       </nova:ports>
Nov 03 16:37:27 user nova-compute[74932]:     </nova:instance>
Nov 03 16:37:27 user nova-compute[74932]:   </metadata>
Nov 03 16:37:27 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:37:27 user nova-compute[74932]:     <system>
Nov 03 16:37:27 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:37:27 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:37:27 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:37:27 user nova-compute[74932]:       <entry name="serial">840e5d07-c2f2-40b3-b05a-23bd8acf56bd</entry>
Nov 03 16:37:27 user nova-compute[74932]:       <entry name="uuid">840e5d07-c2f2-40b3-b05a-23bd8acf56bd</entry>
Nov 03 16:37:27 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:37:27 user nova-compute[74932]:     </system>
Nov 03 16:37:27 user nova-compute[74932]:   </sysinfo>
Nov 03 16:37:27 user nova-compute[74932]:   <os>
Nov 03 16:37:27 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:37:27 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:37:27 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:37:27 user nova-compute[74932]:   </os>
Nov 03 16:37:27 user nova-compute[74932]:   <features>
Nov 03 16:37:27 user nova-compute[74932]:     <acpi/>
Nov 03 16:37:27 user nova-compute[74932]:     <apic/>
Nov 03 16:37:27 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:37:27 user nova-compute[74932]:   </features>
Nov 03 16:37:27 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:37:27 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:37:27 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:37:27 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:37:27 user nova-compute[74932]:   </clock>
Nov 03 16:37:27 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:37:27 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:37:27 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:37:27 user nova-compute[74932]:   </cpu>
Nov 03 16:37:27 user nova-compute[74932]:   <devices>
Nov 03 16:37:27 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:37:27 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:37:27 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk"/>
Nov 03 16:37:27 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:37:27 user nova-compute[74932]:     </disk>
Nov 03 16:37:27 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:37:27 user nova-compute[74932]:       <mac address="fa:16:3e:c2:ac:f3"/>
Nov 03 16:37:27 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:37:27 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:37:27 user nova-compute[74932]:       <target dev="tap8f16a496-af"/>
Nov 03 16:37:27 user nova-compute[74932]:     </interface>
Nov 03 16:37:27 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:37:27 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/console.log" append="off"/>
Nov 03 16:37:27 user nova-compute[74932]:     </serial>
Nov 03 16:37:27 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:37:27 user nova-compute[74932]:     <video>
Nov 03 16:37:27 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:37:27 user nova-compute[74932]:     </video>
Nov 03 16:37:27 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:37:27 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:37:27 user nova-compute[74932]:     </rng>
Nov 03 16:37:27 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:37:27 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:37:27 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:37:27 user nova-compute[74932]:     </memballoon>
Nov 03 16:37:27 user nova-compute[74932]:   </devices>
Nov 03 16:37:27 user nova-compute[74932]: </domain>
Nov 03 16:37:27 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-201867260',display_name='tempest-TestStampPattern-server-201867260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-201867260',id=29,image_ref='b37f05e8-bf67-4229-8ba8-4fb65b55423a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMj9AIFIKO0NgK0zkHn0Jy+l3mgfcxgiBUpQw/9Yol77VWUT8u3eYfCI0rb+RgkX7v+WG5SHkNUka8piM/z+1zFyCPRyze8JQydhtJPBVujfoF47Ahsa+Vb6gz5xkxMaw==',key_name='tempest-TestStampPattern-1337686481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c887cbc267d40dd9e270a25f6baf66f',ramdisk_id='',reservation_id='r-8z9m5rip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ad86cdd7-1253-4246-ac62-32c4898b30df',image_min_disk='1',image_min_ram='0',image_owner_id='2c887cbc267d40dd9e270a25f6baf66f',image_owner_project_name='tempest-TestStampPattern-1606523677',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1606523677-project-member',image_user_id='99403819bf9845ac85cf9ff73a492507',network_allocated='True',owner_project_name='tempest-TestStampPattern-1606523677',owner_user_name='tempest-TestStampPattern-1606523677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:24Z,user_data=None,user_id='99403819bf9845ac85cf9ff73a492507',uuid=840e5d07-c2f2-40b3-b05a-23bd8acf56bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converting VIF {"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_vif [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '154f3e6e-aa1c-520a-8066-ebed993502d9', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a983152f-bfcf-4134-845a-d35b715ee9ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f16a496-af, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f16a496-af, col_values=(('qos', UUID('a4ed9120-e0ee-48bd-b668-1401d0b76bd4')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f16a496-af, col_values=(('external_ids', {'iface-id': '8f16a496-af41-465a-a478-f5c6f43381c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:ac:f3', 'vm-uuid': '840e5d07-c2f2-40b3-b05a-23bd8acf56bd'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d5380-7cec-4882-8209-bef21c3ac7d0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:27 user nova-compute[74932]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:37:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:27 user nova-compute[74932]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:37:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64124310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:27 user nova-compute[74932]: INFO os_vif [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af')
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb511bb-b2c2-45f5-b1a2-8c672f0a603a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95138b55-cd42-46f0-8523-68dde14309b5]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc07425-b5bf-41ef-8694-9c9efc3a0b78]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No VIF found with MAC fa:16:3e:c2:ac:f3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cc544-d470-425a-b65e-e7a5bd08d192]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5099375c-6ce2-491d-bfd4-9332b6319ff0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4bcff-3957-4874-8c52-48efded9dfd2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]
Nov 03 16:37:27 user nova-compute[74932]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.
Nov 03 16:37:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b5de97-bf47-4f24-bc4a-0ba46a15cbe0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== disconnect_volume: return (355ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.neutron [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updated VIF entry in instance network info cache for port 8f16a496-af41-465a-a478-f5c6f43381c1. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG nova.network.neutron [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updating instance_info_cache with network_info: [{"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cd8af9d3-59b3-4405-9419-eff5fa68b9ef req-18b1d548-ba9e-4f46-a54f-823e16014000 service nova] Releasing lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.compute.manager [req-a89f65dc-6296-4538-9c08-54ccbb27c993 req-2fefdf3b-adfa-4b15-b317-8978bfb7e86e service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a89f65dc-6296-4538-9c08-54ccbb27c993 req-2fefdf3b-adfa-4b15-b317-8978bfb7e86e service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a89f65dc-6296-4538-9c08-54ccbb27c993 req-2fefdf3b-adfa-4b15-b317-8978bfb7e86e service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a89f65dc-6296-4538-9c08-54ccbb27c993 req-2fefdf3b-adfa-4b15-b317-8978bfb7e86e service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.compute.manager [req-a89f65dc-6296-4538-9c08-54ccbb27c993 req-2fefdf3b-adfa-4b15-b317-8978bfb7e86e service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:28 user nova-compute[74932]: WARNING nova.compute.manager [req-a89f65dc-6296-4538-9c08-54ccbb27c993 req-2fefdf3b-adfa-4b15-b317-8978bfb7e86e service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state active and task_state rebuilding.
Nov 03 16:37:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance destroyed successfully.
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215066673',display_name='tempest-ServerActionsTestOtherA-server-53930940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-215066673',id=26,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVvr0cOtKAT7q7hEiUPtDBtsG9isgtmhqmtyfJlhfgje5zhIt7ontVt7eFV354uWtYe4DTjFXkkopLougoy6YNRz/8ZrTy44IyY937kIpKjwA/qUZYUJ0HOSdd+yheqxw==',key_name='tempest-keypair-593339944',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-fehc8j4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=5aa105d4-e07c-48aa-8931-528c4c924e03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce1737f3-67, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=482f349e-cfff-484a-8856-f9ad0bd361a1) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: INFO os_vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67')
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:28 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad4dad-e538-4a13-94b5-68e4672d5d34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:37:28 user nova-compute[74932]: No targets found.
Nov 03 16:37:28 user nova-compute[74932]: iSNS:
Nov 03 16:37:28 user nova-compute[74932]: No targets found.
Nov 03 16:37:28 user nova-compute[74932]: STATIC:
Nov 03 16:37:28 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06
Nov 03 16:37:28 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:37:28 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:37:28 user nova-compute[74932]: FIRMWARE:
Nov 03 16:37:28 user nova-compute[74932]: No targets found.
Nov 03 16:37:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:37:28 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:37:28 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277350c-111b-48b7-9256-d1ee4c36d213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab20097c-6baf-49e6-87ca-5337bb78c03c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645b28c0>, {}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Disconnecting from: [] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== disconnect_volume: return (76ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:37:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Deleting instance files /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03_del
Nov 03 16:37:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Deletion of /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03_del complete
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:28 user nova-compute[74932]: INFO nova.virt.block_device [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Booting with volume a96b913e-a89b-49e2-9cdd-9707f2c99d5e at /dev/vdb
Nov 03 16:37:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG os_brick.utils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef0506-683d-4d79-95db-8aa98fc94ab1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbcd626-f298-44cb-8699-525332cc4956]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3abb616-2661-4eb6-b7d6-661b2986b1c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9537af62-22df-43ee-948e-2a6fe243e9fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:37:29 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:37:29 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[86918257-b1df-43cc-ae5f-4bb4e6befc8c]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG os_brick.utils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updating existing volume attachment record: 1072b916-4ed5-4c49-8508-0e8bd2bddc9c {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:37:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] No waiting events found dispatching network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:30 user nova-compute[74932]: WARNING nova.compute.manager [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received unexpected event network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 for instance with vm_state building and task_state spawning.
Nov 03 16:37:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] No waiting events found dispatching network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:30 user nova-compute[74932]: WARNING nova.compute.manager [req-5ba4107f-4301-4eec-b8e1-1e8f088061ab req-c361165c-4e38-4c1e-9741-ba7eb0c38978 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received unexpected event network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 for instance with vm_state building and task_state spawning.
Nov 03 16:37:31 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:37:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:37:31 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Instance spawned successfully.
Nov 03 16:37:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:37:32 user nova-compute[74932]: INFO nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 03 16:37:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:37:32 user nova-compute[74932]: INFO nova.compute.manager [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Took 8.83 seconds to build instance.
Nov 03 16:37:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-86a0fcd0-74c7-4058-b055-7a92fd33e7b9 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.960s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing instance network info cache due to event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG nova.network.neutron [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:37:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:33 user nova-compute[74932]: DEBUG nova.network.neutron [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updated VIF entry in instance network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:37:33 user nova-compute[74932]: DEBUG nova.network.neutron [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-47b058a7-3853-4940-a5f0-1db43d2acfd9 req-a892c20b-7a68-4408-8fd0-61f2b1ae0bcd service nova] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:34 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:37:34 user nova-compute[74932]: INFO nova.compute.manager [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] instance snapshotting
Nov 03 16:37:34 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Beginning live snapshot process
Nov 03 16:37:34 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp04gv0x_r/4f3c85395532456ea12cca04bd066fed.delta 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:35 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp04gv0x_r/4f3c85395532456ea12cca04bd066fed.delta 1073741824" returned: 0 in 0.068s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:35 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 16:37:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:37:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:37:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 16:37:37 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp04gv0x_r/4f3c85395532456ea12cca04bd066fed.delta /opt/stack/data/nova/instances/snapshots/tmp04gv0x_r/4f3c85395532456ea12cca04bd066fed {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: INFO nova.compute.manager [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Unrescuing
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:37:37 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 is timed out.
Nov 03 16:37:37 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully detached device vdb from instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 from the live domain config.
Nov 03 16:37:37 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CryUcNgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:37 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbb1093-67cd-496f-a292-2b81600787d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:37:37 user nova-compute[74932]: No targets found.
Nov 03 16:37:37 user nova-compute[74932]: iSNS:
Nov 03 16:37:37 user nova-compute[74932]: No targets found.
Nov 03 16:37:37 user nova-compute[74932]: STATIC:
Nov 03 16:37:37 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06
Nov 03 16:37:37 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:37:37 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:37:37 user nova-compute[74932]: FIRMWARE:
Nov 03 16:37:37 user nova-compute[74932]: No targets found.
Nov 03 16:37:37 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:37:37 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:37:37 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8253f-f23f-47b2-9107-3ee3671430cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[232419cc-ce07-4873-acfd-a655d938ef89]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:37 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 (non-flash)
Nov 03 16:37:37 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc843a7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98757e0-84b9-4dc8-8493-bb3d68556e1d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b52bd-afe0-4b40-9bda-431dff545604]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a3b7e-1a0a-4259-899a-97cfd53d5efe]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp04gv0x_r/4f3c85395532456ea12cca04bd066fed.delta /opt/stack/data/nova/instances/snapshots/tmp04gv0x_r/4f3c85395532456ea12cca04bd066fed" returned: 0 in 0.560s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Snapshot extracted, beginning image upload
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc13fd-5746-47ce-a4c6-59e3484182a0]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f7acb9-3c96-4fa5-9afe-e2ccb3ffe277]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db9a07-ca24-416a-9d28-98efb9ce7b85]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260]
Nov 03 16:37:37 user nova-compute[74932]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06, portal: 172.16.0.220,3260] successful.
Nov 03 16:37:37 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc37210-8e1e-47af-ad94-67232b4b8d06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[463e64db-270b-456f-ad99-76d0977e6606]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== disconnect_volume: return (427ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:37:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:37:38 user nova-compute[74932]: INFO nova.compute.claims [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Claim successful on node user
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.network.neutron [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'flavor' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f45b4e8-3784-431a-9116-01e622a42e9a req-57931ee1-414e-4f26-a257-e0013e091d09 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f45b4e8-3784-431a-9116-01e622a42e9a req-57931ee1-414e-4f26-a257-e0013e091d09 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f45b4e8-3784-431a-9116-01e622a42e9a req-57931ee1-414e-4f26-a257-e0013e091d09 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f45b4e8-3784-431a-9116-01e622a42e9a req-57931ee1-414e-4f26-a257-e0013e091d09 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f45b4e8-3784-431a-9116-01e622a42e9a req-57931ee1-414e-4f26-a257-e0013e091d09 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:38 user nova-compute[74932]: WARNING nova.compute.manager [req-1f45b4e8-3784-431a-9116-01e622a42e9a req-57931ee1-414e-4f26-a257-e0013e091d09 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:37:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.782s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:37:38 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:37:38 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:37:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:37:39 user nova-compute[74932]: DEBUG nova.policy [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2fbcaa1d5bb4249b127dcdc0875517a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f123f628d784aaaadba9dea7eb71ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:37:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance destroyed successfully.
Nov 03 16:37:39 user nova-compute[74932]: INFO nova.virt.block_device [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Booting with blank volume at /dev/vda
Nov 03 16:37:39 user nova-compute[74932]: DEBUG nova.objects.instance [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-05992cb0-ff4d-4c42-8395-93f6df3cb86f tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.264s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Successfully created port: dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-aea7b654-28de-4c33-9cc0-e4d1619ef462 req-12f3cba5-01b9-41f8-a361-c171ac572d42 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-aea7b654-28de-4c33-9cc0-e4d1619ef462 req-12f3cba5-01b9-41f8-a361-c171ac572d42 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-aea7b654-28de-4c33-9cc0-e4d1619ef462 req-12f3cba5-01b9-41f8-a361-c171ac572d42 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-aea7b654-28de-4c33-9cc0-e4d1619ef462 req-12f3cba5-01b9-41f8-a361-c171ac572d42 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-aea7b654-28de-4c33-9cc0-e4d1619ef462 req-12f3cba5-01b9-41f8-a361-c171ac572d42 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:40 user nova-compute[74932]: WARNING nova.compute.manager [req-aea7b654-28de-4c33-9cc0-e4d1619ef462 req-12f3cba5-01b9-41f8-a361-c171ac572d42 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:37:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Successfully updated port: dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:37:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Snapshot image upload complete
Nov 03 16:37:41 user nova-compute[74932]: INFO nova.compute.manager [None req-4e4c489e-10a3-498d-b75b-a46263faa7ae tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Took 7.02 seconds to snapshot the instance on the hypervisor.
Nov 03 16:37:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:37:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance network_info: |[{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:42 user nova-compute[74932]: WARNING nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-changed-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Refreshing instance network info cache due to event network-changed-dfb466d0-aa2b-4bb3-b028-740be8874e2b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Acquiring lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Acquired lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Refreshing network info cache for port dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:37:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG nova.network.neutron [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updated VIF entry in instance network info cache for port dfb466d0-aa2b-4bb3-b028-740be8874e2b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG nova.network.neutron [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Releasing lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:43 user nova-compute[74932]: WARNING nova.compute.manager [req-c7db465b-d32b-4b92-8a1d-f10c3fd58823 req-49f1a7fe-bab6-49dd-b628-cb9620053b4c service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:37:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ef4be042-7e40-42e2-86b4-8ce5bf4182ae tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:37:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:46 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Skipping network cache update for instance because it is Building. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:37:49 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG os_brick.utils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2d97a1-e361-4d7c-82f3-07407da88e17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa0f427-aa60-4b36-8702-fe97bd68bacf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95e1fd9-ca99-4b6e-8b0a-6edf206c9571]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[785d6926-daec-46cc-9556-cc36e20e8d4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:37:50 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a36b8a-28f9-450e-86aa-31b699a2e647]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG os_brick.utils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating existing volume attachment record: 3d884dc8-5ecf-4149-b3bd-3dec06955243 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:37:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:37:51 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:37:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:37:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:55 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:37:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:57 user nova-compute[74932]: INFO nova.compute.manager [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Terminating instance
Nov 03 16:37:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-15618b73-8051-4608-9ef6-513ea0033213 req-c32c5d34-f550-4d34-9990-bbe5b8012254 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-vif-unplugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-15618b73-8051-4608-9ef6-513ea0033213 req-c32c5d34-f550-4d34-9990-bbe5b8012254 service nova] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-15618b73-8051-4608-9ef6-513ea0033213 req-c32c5d34-f550-4d34-9990-bbe5b8012254 service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-15618b73-8051-4608-9ef6-513ea0033213 req-c32c5d34-f550-4d34-9990-bbe5b8012254 service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-15618b73-8051-4608-9ef6-513ea0033213 req-c32c5d34-f550-4d34-9990-bbe5b8012254 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] No waiting events found dispatching network-vif-unplugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-15618b73-8051-4608-9ef6-513ea0033213 req-c32c5d34-f550-4d34-9990-bbe5b8012254 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-vif-unplugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Instance destroyed successfully.
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lazy-loading 'resources' on Instance uuid 262ac79d-1bdf-4357-af63-0e6b98fa5b5f {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-178882574',display_name='tempest-VolumesActionsTest-instance-178882574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-178882574',id=28,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:36:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='660be27a2adc4e15b5585a9d90bb5d8a',ramdisk_id='',reservation_id='r-m4jguxre',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-453500561',owner_user_name='tempest-VolumesActionsTest-453500561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:36:14Z,user_data=None,user_id='55c678331ab147d8970f06830f55853b',uuid=262ac79d-1bdf-4357-af63-0e6b98fa5b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converting VIF {"id": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "address": "fa:16:3e:ad:47:54", "network": {"id": "c45e8644-92cc-4b4e-bcf3-5db3e852d576", "bridge": "br-int", "label": "tempest-VolumesActionsTest-332704431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "660be27a2adc4e15b5585a9d90bb5d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb4fe0c-7d", "ovs_interfaceid": "5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG os_vif [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cb4fe0c-7d, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87da31e0-2760-4f35-9b11-865d811fb5f4) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:37:58 user nova-compute[74932]: INFO os_vif [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:47:54,bridge_name='br-int',has_traffic_filtering=True,id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8,network=Network(c45e8644-92cc-4b4e-bcf3-5db3e852d576),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb4fe0c-7d')
Nov 03 16:37:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Deleting instance files /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f_del
Nov 03 16:37:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Deletion of /opt/stack/data/nova/instances/262ac79d-1bdf-4357-af63-0e6b98fa5b5f_del complete
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:58 user nova-compute[74932]: INFO nova.compute.manager [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:58 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid '262ac79d-1bdf-4357-af63-0e6b98fa5b5f' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid '262ac79d-1bdf-4357-af63-0e6b98fa5b5f' (instance-0000001c)
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:59 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Took 0.64 seconds to deallocate network for instance.
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c3742a9e-6110-4df5-8c80-469c5414f5bd req-dd31b921-90ef-4145-abc3-41042f3f0d54 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-vif-deleted-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:59 user nova-compute[74932]: INFO nova.compute.manager [req-c3742a9e-6110-4df5-8c80-469c5414f5bd req-dd31b921-90ef-4145-abc3-41042f3f0d54 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Neutron deleted interface 5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8; detaching it from the instance and deleting it from the info cache
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.network.neutron [req-c3742a9e-6110-4df5-8c80-469c5414f5bd req-dd31b921-90ef-4145-abc3-41042f3f0d54 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-c3742a9e-6110-4df5-8c80-469c5414f5bd req-dd31b921-90ef-4145-abc3-41042f3f0d54 service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Detach interface failed, port_id=5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8, reason: Instance 262ac79d-1bdf-4357-af63-0e6b98fa5b5f could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:37:59 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Deleted allocations for instance 262ac79d-1bdf-4357-af63-0e6b98fa5b5f
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-2e7dbe96-3138-4b01-aa3b-39b4ece29bcf req-6e884858-88a0-47de-bfa3-de7d194b009b service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received event network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2e7dbe96-3138-4b01-aa3b-39b4ece29bcf req-6e884858-88a0-47de-bfa3-de7d194b009b service nova] Acquiring lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2e7dbe96-3138-4b01-aa3b-39b4ece29bcf req-6e884858-88a0-47de-bfa3-de7d194b009b service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2e7dbe96-3138-4b01-aa3b-39b4ece29bcf req-6e884858-88a0-47de-bfa3-de7d194b009b service nova] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-2e7dbe96-3138-4b01-aa3b-39b4ece29bcf req-6e884858-88a0-47de-bfa3-de7d194b009b service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] No waiting events found dispatching network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:37:59 user nova-compute[74932]: WARNING nova.compute.manager [req-2e7dbe96-3138-4b01-aa3b-39b4ece29bcf req-6e884858-88a0-47de-bfa3-de7d194b009b service nova] [instance: 262ac79d-1bdf-4357-af63-0e6b98fa5b5f] Received unexpected event network-vif-plugged-5cb4fe0c-7d2b-48ef-9bcf-90f1ec156cd8 for instance with vm_state deleted and task_state None.
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a55fffa1-2c79-48b1-b0cf-3f6a422ae2bf tempest-VolumesActionsTest-453500561 tempest-VolumesActionsTest-453500561-project-member] Lock "262ac79d-1bdf-4357-af63-0e6b98fa5b5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.496s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:37:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:00 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:38:00 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=25.001163482666016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5aa105d4-e07c-48aa-8931-528c4c924e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:38:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:06 user nova-compute[74932]: INFO nova.compute.manager [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Terminating instance
Nov 03 16:38:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-ca395f7d-0943-4402-b148-e5ad8a97d82c req-80e05f2d-f08b-43b9-943e-d92a9893d761 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-vif-unplugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ca395f7d-0943-4402-b148-e5ad8a97d82c req-80e05f2d-f08b-43b9-943e-d92a9893d761 service nova] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ca395f7d-0943-4402-b148-e5ad8a97d82c req-80e05f2d-f08b-43b9-943e-d92a9893d761 service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ca395f7d-0943-4402-b148-e5ad8a97d82c req-80e05f2d-f08b-43b9-943e-d92a9893d761 service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-ca395f7d-0943-4402-b148-e5ad8a97d82c req-80e05f2d-f08b-43b9-943e-d92a9893d761 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] No waiting events found dispatching network-vif-unplugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-ca395f7d-0943-4402-b148-e5ad8a97d82c req-80e05f2d-f08b-43b9-943e-d92a9893d761 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-vif-unplugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:38:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Instance destroyed successfully.
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'resources' on Instance uuid 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-233470834',display_name='tempest-AttachVolumeNegativeTest-server-233470834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-233470834',id=24,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZiWLie4NWO5Lg57HK1q5JB43rh76/j2/CnWSAwgILe99DNr8Bi5PXndcWJfdQz90iuBIJhpt09EKyegUoS66rgS3kPESDt8cAXM73zel5Gzm5lCSObS+tNqnQD7lx3Tg==',key_name='tempest-keypair-1195561208',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:34:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-w3nv91tc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=96c96404-d743-4c8e-bf6a-b85b5d9c2eb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "address": "fa:16:3e:6d:45:f8", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59260b8c-b4", "ovs_interfaceid": "59260b8c-b47c-461e-bd16-cc0f8ad3b33e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG os_vif [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59260b8c-b4, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=657511fb-26a7-4c2c-8959-c24f046960fb) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:07 user nova-compute[74932]: INFO os_vif [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:45:f8,bridge_name='br-int',has_traffic_filtering=True,id=59260b8c-b47c-461e-bd16-cc0f8ad3b33e,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59260b8c-b4')
Nov 03 16:38:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Deleting instance files /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3_del
Nov 03 16:38:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Deletion of /opt/stack/data/nova/instances/96c96404-d743-4c8e-bf6a-b85b5d9c2eb3_del complete
Nov 03 16:38:07 user nova-compute[74932]: INFO nova.compute.manager [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 03 16:38:07 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:38:07 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:38:08 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Took 0.88 seconds to deallocate network for instance.
Nov 03 16:38:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-7e0325e1-2e3b-407b-9ca5-92d5b150b509 req-c35ad244-35b7-4e2d-8030-f4e0e02cf751 service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-vif-deleted-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:38:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:08 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Deleted allocations for instance 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3
Nov 03 16:38:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7d270bad-d3b6-4fc1-980a-569c69e59fef tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-4a12f540-f87a-4b38-8f31-91def1f655ad req-c1df4bf0-c945-4a94-b6f3-988630f7b9de service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received event network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4a12f540-f87a-4b38-8f31-91def1f655ad req-c1df4bf0-c945-4a94-b6f3-988630f7b9de service nova] Acquiring lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4a12f540-f87a-4b38-8f31-91def1f655ad req-c1df4bf0-c945-4a94-b6f3-988630f7b9de service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4a12f540-f87a-4b38-8f31-91def1f655ad req-c1df4bf0-c945-4a94-b6f3-988630f7b9de service nova] Lock "96c96404-d743-4c8e-bf6a-b85b5d9c2eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-4a12f540-f87a-4b38-8f31-91def1f655ad req-c1df4bf0-c945-4a94-b6f3-988630f7b9de service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] No waiting events found dispatching network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:38:09 user nova-compute[74932]: WARNING nova.compute.manager [req-4a12f540-f87a-4b38-8f31-91def1f655ad req-c1df4bf0-c945-4a94-b6f3-988630f7b9de service nova] [instance: 96c96404-d743-4c8e-bf6a-b85b5d9c2eb3] Received unexpected event network-vif-plugged-59260b8c-b47c-461e-bd16-cc0f8ad3b33e for instance with vm_state deleted and task_state None.
Nov 03 16:38:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:38:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Creating image(s)
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:38:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Creating image(s)
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Ensure instance console log exists: /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Start _get_guest_xml network_info=[{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4fda841d-fbf5-441b-906c-9cc3b12e6ac1', 'attached_at': '', 'detached_at': '', 'volume_id': '5206edfc-e197-4e82-ae3a-772043b5e562', 'serial': '5206edfc-e197-4e82-ae3a-772043b5e562'}, 'attachment_id': '3d884dc8-5ecf-4149-b3bd-3dec06955243', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:38:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:38:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:38:13 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:38:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:38:13 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:38:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:38:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:38:13 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:38:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870e945-2172-4fd2-bb10-a9332587cefb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:38:14 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[30046f80-1fcd-4b22-9338-7e6cb9776951]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562] added
Nov 03 16:38:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee26f49-cdfb-47b6-ada2-dc371ca35c94]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a05bc-18d6-4cd1-b79f-62858d42b292]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdKtRYC {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdKtRYC" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da44890-9571-4519-b9a3-75f86baa3fb8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXdKtRYC'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7da309-263a-4b8f-aebc-ef85e7b69d00]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf2de76-cab5-4173-ba6b-70caaa22e4bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:38:14 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:38:14 user nova-compute[74932]:  {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:38:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 16:38:14 user nova-compute[74932]: 
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d53206-d2ab-495d-b97d-c8b606fc7019]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260]
Nov 03 16:38:14 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260] successful.
Nov 03 16:38:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk 1073741824" returned: 0 in 0.057s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd348b-1cff-4911-b981-11ba888739cc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f9aa99-3bec-485f-8f68-c8b3e5720c20]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:38:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:38:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd32b7-43b4-41af-ba80-6f60eca96211]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Cannot resize image /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Ensure instance console log exists: /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Start _get_guest_xml network_info=[{"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aa105d4-e07c-48aa-8931-528c4c924e03', 'attached_at': '', 'detached_at': '', 'volume_id': 'a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'serial': 'a96b913e-a89b-49e2-9cdd-9707f2c99d5e'}, 'attachment_id': '1072b916-4ed5-4c49-8508-0e8bd2bddc9c', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:38:14 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 16:38:14 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:38:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 16:38:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26535303339623666', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535303339623666', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.570s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:38:15 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:38:15 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8832c0f-32d3-41ab-9efa-60f4aac5d42b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:38:15 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1372592949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1372592949',id=30,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-t7m0i33j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:39Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=4fda841d-fbf5-441b-906c-9cc3b12e6ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f844a9-0335-421f-a888-85ab9e83861f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e] added
Nov 03 16:38:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:38:15 user nova-compute[74932]:   <uuid>4fda841d-fbf5-441b-906c-9cc3b12e6ac1</uuid>
Nov 03 16:38:15 user nova-compute[74932]:   <name>instance-0000001e</name>
Nov 03 16:38:15 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:38:15 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:38:15 user nova-compute[74932]:   <metadata>
Nov 03 16:38:15 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:38:15 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:38:15 user nova-compute[74932]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1372592949</nova:name>
Nov 03 16:38:15 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:38:13</nova:creationTime>
Nov 03 16:38:15 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:38:15 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:38:15 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:38:15 user nova-compute[74932]:       <nova:owner>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:user uuid="f2fbcaa1d5bb4249b127dcdc0875517a">tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member</nova:user>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:project uuid="5f123f628d784aaaadba9dea7eb71ce2">tempest-ServerBootFromVolumeStableRescueTest-2083155834</nova:project>
Nov 03 16:38:15 user nova-compute[74932]:       </nova:owner>
Nov 03 16:38:15 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:38:15 user nova-compute[74932]:       <nova:ports>
Nov 03 16:38:15 user nova-compute[74932]:         <nova:port uuid="dfb466d0-aa2b-4bb3-b028-740be8874e2b">
Nov 03 16:38:15 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 16:38:15 user nova-compute[74932]:         </nova:port>
Nov 03 16:38:15 user nova-compute[74932]:       </nova:ports>
Nov 03 16:38:15 user nova-compute[74932]:     </nova:instance>
Nov 03 16:38:15 user nova-compute[74932]:   </metadata>
Nov 03 16:38:15 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:38:15 user nova-compute[74932]:     <system>
Nov 03 16:38:15 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:38:15 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:38:15 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:38:15 user nova-compute[74932]:       <entry name="serial">4fda841d-fbf5-441b-906c-9cc3b12e6ac1</entry>
Nov 03 16:38:15 user nova-compute[74932]:       <entry name="uuid">4fda841d-fbf5-441b-906c-9cc3b12e6ac1</entry>
Nov 03 16:38:15 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:38:15 user nova-compute[74932]:     </system>
Nov 03 16:38:15 user nova-compute[74932]:   </sysinfo>
Nov 03 16:38:15 user nova-compute[74932]:   <os>
Nov 03 16:38:15 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:38:15 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:38:15 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:38:15 user nova-compute[74932]:   </os>
Nov 03 16:38:15 user nova-compute[74932]:   <features>
Nov 03 16:38:15 user nova-compute[74932]:     <acpi/>
Nov 03 16:38:15 user nova-compute[74932]:     <apic/>
Nov 03 16:38:15 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:38:15 user nova-compute[74932]:   </features>
Nov 03 16:38:15 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:38:15 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:38:15 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:38:15 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:38:15 user nova-compute[74932]:   </clock>
Nov 03 16:38:15 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:38:15 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:38:15 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:38:15 user nova-compute[74932]:   </cpu>
Nov 03 16:38:15 user nova-compute[74932]:   <devices>
Nov 03 16:38:15 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:38:15 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:38:15 user nova-compute[74932]:       <source dev="/dev/sdb"/>
Nov 03 16:38:15 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:38:15 user nova-compute[74932]:       <serial>5206edfc-e197-4e82-ae3a-772043b5e562</serial>
Nov 03 16:38:15 user nova-compute[74932]:     </disk>
Nov 03 16:38:15 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:38:15 user nova-compute[74932]:       <mac address="fa:16:3e:c5:77:45"/>
Nov 03 16:38:15 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:38:15 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:38:15 user nova-compute[74932]:       <target dev="tapdfb466d0-aa"/>
Nov 03 16:38:15 user nova-compute[74932]:     </interface>
Nov 03 16:38:15 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:38:15 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/console.log" append="off"/>
Nov 03 16:38:15 user nova-compute[74932]:     </serial>
Nov 03 16:38:15 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:38:15 user nova-compute[74932]:     <video>
Nov 03 16:38:15 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:38:15 user nova-compute[74932]:     </video>
Nov 03 16:38:15 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:38:15 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:38:15 user nova-compute[74932]:     </rng>
Nov 03 16:38:15 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:38:15 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:38:15 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:38:15 user nova-compute[74932]:     </memballoon>
Nov 03 16:38:15 user nova-compute[74932]:   </devices>
Nov 03 16:38:15 user nova-compute[74932]: </domain>
Nov 03 16:38:15 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1372592949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1372592949',id=30,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-t7m0i33j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:39Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=4fda841d-fbf5-441b-906c-9cc3b12e6ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_vif [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '686d0546-8adf-53e1-93f0-26cd34a865ca', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b60a0-cfde-4060-b8e6-410cd00c9d28]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfb466d0-aa, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfb466d0-aa, col_values=(('qos', UUID('e8ca22f3-e949-412c-8dfb-c9054aad0751')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfb466d0-aa, col_values=(('external_ids', {'iface-id': 'dfb466d0-aa2b-4bb3-b028-740be8874e2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:77:45', 'vm-uuid': '4fda841d-fbf5-441b-906c-9cc3b12e6ac1'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:15 user nova-compute[74932]: INFO os_vif [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa')
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee77226-bd77-41cd-b451-7bcd86d968fc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVxPOtbC {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVxPOtbC" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f0acf-82e7-4dab-8f81-2955942550be]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVxPOtbC'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac53e214-cadd-44d7-9432-e2286c338ac3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No VIF found with MAC fa:16:3e:c5:77:45, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8d30cb-eebb-4c96-ab03-8e5bb378baf9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:38:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:38:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64f5ed-dbd4-41a7-a335-85c3c5c7e12a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]
Nov 03 16:38:15 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.
Nov 03 16:38:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c4604a-d3a1-4c88-8761-738c8ac540c2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf36c51d-6f59-4a22-badd-89044be14db5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:38:15 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:38:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:38:15 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:38:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5642990-74b7-44be-ae18-c0dcda87f512]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:38:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== connect_volume: return (1906ms) {'type': 'block', 'scsi_wwn': '23238303265633637', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238303265633637', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215066673',display_name='tempest-ServerActionsTestOtherA-server-53930940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-215066673',id=26,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVvr0cOtKAT7q7hEiUPtDBtsG9isgtmhqmtyfJlhfgje5zhIt7ontVt7eFV354uWtYe4DTjFXkkopLougoy6YNRz/8ZrTy44IyY937kIpKjwA/qUZYUJ0HOSdd+yheqxw==',key_name='tempest-keypair-593339944',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-fehc8j4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=5aa105d4-e07c-48aa-8931-528c4c924e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:38:16 user nova-compute[74932]:   <uuid>5aa105d4-e07c-48aa-8931-528c4c924e03</uuid>
Nov 03 16:38:16 user nova-compute[74932]:   <name>instance-0000001a</name>
Nov 03 16:38:16 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:38:16 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:38:16 user nova-compute[74932]:   <metadata>
Nov 03 16:38:16 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:38:16 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:38:16 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherA-server-53930940</nova:name>
Nov 03 16:38:16 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:38:14</nova:creationTime>
Nov 03 16:38:16 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:38:16 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:38:16 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:38:16 user nova-compute[74932]:       <nova:owner>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:user uuid="90fa01b533204995b57b88b0a4aac138">tempest-ServerActionsTestOtherA-1516695200-project-member</nova:user>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:project uuid="9a8cbb942aff476ebf7cca3968447573">tempest-ServerActionsTestOtherA-1516695200</nova:project>
Nov 03 16:38:16 user nova-compute[74932]:       </nova:owner>
Nov 03 16:38:16 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:38:16 user nova-compute[74932]:       <nova:ports>
Nov 03 16:38:16 user nova-compute[74932]:         <nova:port uuid="ce1737f3-6745-49e5-89de-7cd37dac064b">
Nov 03 16:38:16 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 16:38:16 user nova-compute[74932]:         </nova:port>
Nov 03 16:38:16 user nova-compute[74932]:       </nova:ports>
Nov 03 16:38:16 user nova-compute[74932]:     </nova:instance>
Nov 03 16:38:16 user nova-compute[74932]:   </metadata>
Nov 03 16:38:16 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:38:16 user nova-compute[74932]:     <system>
Nov 03 16:38:16 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:38:16 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:38:16 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:38:16 user nova-compute[74932]:       <entry name="serial">5aa105d4-e07c-48aa-8931-528c4c924e03</entry>
Nov 03 16:38:16 user nova-compute[74932]:       <entry name="uuid">5aa105d4-e07c-48aa-8931-528c4c924e03</entry>
Nov 03 16:38:16 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:38:16 user nova-compute[74932]:     </system>
Nov 03 16:38:16 user nova-compute[74932]:   </sysinfo>
Nov 03 16:38:16 user nova-compute[74932]:   <os>
Nov 03 16:38:16 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:38:16 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:38:16 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:38:16 user nova-compute[74932]:   </os>
Nov 03 16:38:16 user nova-compute[74932]:   <features>
Nov 03 16:38:16 user nova-compute[74932]:     <acpi/>
Nov 03 16:38:16 user nova-compute[74932]:     <apic/>
Nov 03 16:38:16 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:38:16 user nova-compute[74932]:   </features>
Nov 03 16:38:16 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:38:16 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:38:16 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:38:16 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:38:16 user nova-compute[74932]:   </clock>
Nov 03 16:38:16 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:38:16 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:38:16 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:38:16 user nova-compute[74932]:   </cpu>
Nov 03 16:38:16 user nova-compute[74932]:   <devices>
Nov 03 16:38:16 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:38:16 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:38:16 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk"/>
Nov 03 16:38:16 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:38:16 user nova-compute[74932]:     </disk>
Nov 03 16:38:16 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:38:16 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:38:16 user nova-compute[74932]:       <source dev="/dev/sdc"/>
Nov 03 16:38:16 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:38:16 user nova-compute[74932]:       <serial>a96b913e-a89b-49e2-9cdd-9707f2c99d5e</serial>
Nov 03 16:38:16 user nova-compute[74932]:     </disk>
Nov 03 16:38:16 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:38:16 user nova-compute[74932]:       <mac address="fa:16:3e:48:58:95"/>
Nov 03 16:38:16 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:38:16 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:38:16 user nova-compute[74932]:       <target dev="tapce1737f3-67"/>
Nov 03 16:38:16 user nova-compute[74932]:     </interface>
Nov 03 16:38:16 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:38:16 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/console.log" append="off"/>
Nov 03 16:38:16 user nova-compute[74932]:     </serial>
Nov 03 16:38:16 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:38:16 user nova-compute[74932]:     <video>
Nov 03 16:38:16 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:38:16 user nova-compute[74932]:     </video>
Nov 03 16:38:16 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:38:16 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:38:16 user nova-compute[74932]:     </rng>
Nov 03 16:38:16 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:38:16 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:38:16 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:38:16 user nova-compute[74932]:     </memballoon>
Nov 03 16:38:16 user nova-compute[74932]:   </devices>
Nov 03 16:38:16 user nova-compute[74932]: </domain>
Nov 03 16:38:16 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215066673',display_name='tempest-ServerActionsTestOtherA-server-53930940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-215066673',id=26,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVvr0cOtKAT7q7hEiUPtDBtsG9isgtmhqmtyfJlhfgje5zhIt7ontVt7eFV354uWtYe4DTjFXkkopLougoy6YNRz/8ZrTy44IyY937kIpKjwA/qUZYUJ0HOSdd+yheqxw==',key_name='tempest-keypair-593339944',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-fehc8j4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=5aa105d4-e07c-48aa-8931-528c4c924e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG os_vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ae5d9e3-fbda-5799-8bc8-ccff61e9aea4', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce1737f3-67, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce1737f3-67, col_values=(('qos', UUID('ab504a4b-c687-47dc-9040-5fa02ae9876e')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce1737f3-67, col_values=(('external_ids', {'iface-id': 'ce1737f3-6745-49e5-89de-7cd37dac064b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:58:95', 'vm-uuid': '5aa105d4-e07c-48aa-8931-528c4c924e03'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: INFO os_vif [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67')
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:38:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No VIF found with MAC fa:16:3e:48:58:95, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:38:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-23d834b7-34e6-4494-938c-602b396f1f3b req-0a724cf3-8d97-4948-a52f-5ec23caeb49d service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-23d834b7-34e6-4494-938c-602b396f1f3b req-0a724cf3-8d97-4948-a52f-5ec23caeb49d service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-23d834b7-34e6-4494-938c-602b396f1f3b req-0a724cf3-8d97-4948-a52f-5ec23caeb49d service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-23d834b7-34e6-4494-938c-602b396f1f3b req-0a724cf3-8d97-4948-a52f-5ec23caeb49d service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-23d834b7-34e6-4494-938c-602b396f1f3b req-0a724cf3-8d97-4948-a52f-5ec23caeb49d service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:38:17 user nova-compute[74932]: WARNING nova.compute.manager [req-23d834b7-34e6-4494-938c-602b396f1f3b req-0a724cf3-8d97-4948-a52f-5ec23caeb49d service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state building and task_state spawning.
Nov 03 16:38:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-eecccbdf-468e-4b7d-b62f-d151a27abfd0 req-92bf4fbe-9290-4b36-8786-2c1a50bfed00 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eecccbdf-468e-4b7d-b62f-d151a27abfd0 req-92bf4fbe-9290-4b36-8786-2c1a50bfed00 service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eecccbdf-468e-4b7d-b62f-d151a27abfd0 req-92bf4fbe-9290-4b36-8786-2c1a50bfed00 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eecccbdf-468e-4b7d-b62f-d151a27abfd0 req-92bf4fbe-9290-4b36-8786-2c1a50bfed00 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-eecccbdf-468e-4b7d-b62f-d151a27abfd0 req-92bf4fbe-9290-4b36-8786-2c1a50bfed00 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:38:18 user nova-compute[74932]: WARNING nova.compute.manager [req-eecccbdf-468e-4b7d-b62f-d151a27abfd0 req-92bf4fbe-9290-4b36-8786-2c1a50bfed00 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state active and task_state rebuild_spawning.
Nov 03 16:38:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-e03abbb1-9d16-4aff-abb2-c7dfca3c4424 req-aebb7d59-635c-40a9-b647-9bbcc97c1a26 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e03abbb1-9d16-4aff-abb2-c7dfca3c4424 req-aebb7d59-635c-40a9-b647-9bbcc97c1a26 service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e03abbb1-9d16-4aff-abb2-c7dfca3c4424 req-aebb7d59-635c-40a9-b647-9bbcc97c1a26 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e03abbb1-9d16-4aff-abb2-c7dfca3c4424 req-aebb7d59-635c-40a9-b647-9bbcc97c1a26 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-e03abbb1-9d16-4aff-abb2-c7dfca3c4424 req-aebb7d59-635c-40a9-b647-9bbcc97c1a26 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:38:19 user nova-compute[74932]: WARNING nova.compute.manager [req-e03abbb1-9d16-4aff-abb2-c7dfca3c4424 req-aebb7d59-635c-40a9-b647-9bbcc97c1a26 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state building and task_state spawning.
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:38:20 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance spawned successfully.
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: INFO nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:38:20 user nova-compute[74932]: INFO nova.compute.manager [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Took 42.35 seconds to build instance.
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2e7a48e8-e12a-4a3a-9a6d-92e9c55b117d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.484s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:38:20 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance spawned successfully.
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.compute.manager [req-d6e541b2-5a5b-45dc-aa52-7ae0e90c65bd req-7b5e20db-0182-435d-b009-3ca37ebe75bf service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d6e541b2-5a5b-45dc-aa52-7ae0e90c65bd req-7b5e20db-0182-435d-b009-3ca37ebe75bf service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d6e541b2-5a5b-45dc-aa52-7ae0e90c65bd req-7b5e20db-0182-435d-b009-3ca37ebe75bf service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d6e541b2-5a5b-45dc-aa52-7ae0e90c65bd req-7b5e20db-0182-435d-b009-3ca37ebe75bf service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.compute.manager [req-d6e541b2-5a5b-45dc-aa52-7ae0e90c65bd req-7b5e20db-0182-435d-b009-3ca37ebe75bf service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:38:20 user nova-compute[74932]: WARNING nova.compute.manager [req-d6e541b2-5a5b-45dc-aa52-7ae0e90c65bd req-7b5e20db-0182-435d-b009-3ca37ebe75bf service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state active and task_state rebuild_spawning.
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74932) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 03 16:38:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2dde487e-2d75-4cab-b56a-9daad724612a tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:38:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:45 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:48 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:38:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:38:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:38:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:38:51 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:38:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:38:51 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:38:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:38:56 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:57 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:38:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:38:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:39:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=25.015323638916016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5aa105d4-e07c-48aa-8931-528c4c924e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.550s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:39:01 user nova-compute[74932]: INFO nova.compute.claims [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Claim successful on node user
Nov 03 16:39:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:39:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:39:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.policy [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72b635150c614e459357225b83825e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be38a61a4094c9695a4111abe168c74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:39:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Creating image(s)
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "/opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "/opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk 1073741824" returned: 0 in 0.053s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Successfully created port: 062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Cannot resize image /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Ensure instance console log exists: /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Successfully updated port: 062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquired lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-changed-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Refreshing instance network info cache due to event network-changed-062ca92a-1357-4dc6-9899-fe4b4c710d6b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] Acquiring lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updating instance_info_cache with network_info: [{"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Releasing lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Instance network_info: |[{"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] Acquired lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.neutron [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Refreshing network info cache for port 062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Start _get_guest_xml network_info=[{"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:39:04 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:04 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-131860839',display_name='tempest-AttachVolumeNegativeTest-server-131860839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-131860839',id=31,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXtPTi48w6JLACIuPaWDs/KxmU8xyEMyHRwLIXCz5svrE8D66g9v7n1nLQNFxfEyIkW4e30wb2kWf539pmum3o9NQjQt1K593ijCdAfKBVHHMQrAsbu+HKFoUDk/5FUUw==',key_name='tempest-keypair-1796001998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-gsq20oqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=1d3c17fc-aceb-4974-a312-6d8241fd45ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.objects.instance [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:39:04 user nova-compute[74932]:   <uuid>1d3c17fc-aceb-4974-a312-6d8241fd45ce</uuid>
Nov 03 16:39:04 user nova-compute[74932]:   <name>instance-0000001f</name>
Nov 03 16:39:04 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:39:04 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:39:04 user nova-compute[74932]:   <metadata>
Nov 03 16:39:04 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:39:04 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:39:04 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeNegativeTest-server-131860839</nova:name>
Nov 03 16:39:04 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:39:04</nova:creationTime>
Nov 03 16:39:04 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:39:04 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:39:04 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:39:04 user nova-compute[74932]:       <nova:owner>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:user uuid="72b635150c614e459357225b83825e63">tempest-AttachVolumeNegativeTest-855411700-project-member</nova:user>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:project uuid="3be38a61a4094c9695a4111abe168c74">tempest-AttachVolumeNegativeTest-855411700</nova:project>
Nov 03 16:39:04 user nova-compute[74932]:       </nova:owner>
Nov 03 16:39:04 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:39:04 user nova-compute[74932]:       <nova:ports>
Nov 03 16:39:04 user nova-compute[74932]:         <nova:port uuid="062ca92a-1357-4dc6-9899-fe4b4c710d6b">
Nov 03 16:39:04 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 16:39:04 user nova-compute[74932]:         </nova:port>
Nov 03 16:39:04 user nova-compute[74932]:       </nova:ports>
Nov 03 16:39:04 user nova-compute[74932]:     </nova:instance>
Nov 03 16:39:04 user nova-compute[74932]:   </metadata>
Nov 03 16:39:04 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:39:04 user nova-compute[74932]:     <system>
Nov 03 16:39:04 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:39:04 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:39:04 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:39:04 user nova-compute[74932]:       <entry name="serial">1d3c17fc-aceb-4974-a312-6d8241fd45ce</entry>
Nov 03 16:39:04 user nova-compute[74932]:       <entry name="uuid">1d3c17fc-aceb-4974-a312-6d8241fd45ce</entry>
Nov 03 16:39:04 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:39:04 user nova-compute[74932]:     </system>
Nov 03 16:39:04 user nova-compute[74932]:   </sysinfo>
Nov 03 16:39:04 user nova-compute[74932]:   <os>
Nov 03 16:39:04 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:39:04 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:39:04 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:39:04 user nova-compute[74932]:   </os>
Nov 03 16:39:04 user nova-compute[74932]:   <features>
Nov 03 16:39:04 user nova-compute[74932]:     <acpi/>
Nov 03 16:39:04 user nova-compute[74932]:     <apic/>
Nov 03 16:39:04 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:39:04 user nova-compute[74932]:   </features>
Nov 03 16:39:04 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:39:04 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:39:04 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:39:04 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:39:04 user nova-compute[74932]:   </clock>
Nov 03 16:39:04 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:39:04 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:39:04 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:39:04 user nova-compute[74932]:   </cpu>
Nov 03 16:39:04 user nova-compute[74932]:   <devices>
Nov 03 16:39:04 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:39:04 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:39:04 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk"/>
Nov 03 16:39:04 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:39:04 user nova-compute[74932]:     </disk>
Nov 03 16:39:04 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:39:04 user nova-compute[74932]:       <mac address="fa:16:3e:79:38:70"/>
Nov 03 16:39:04 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:39:04 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:39:04 user nova-compute[74932]:       <target dev="tap062ca92a-13"/>
Nov 03 16:39:04 user nova-compute[74932]:     </interface>
Nov 03 16:39:04 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:39:04 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/console.log" append="off"/>
Nov 03 16:39:04 user nova-compute[74932]:     </serial>
Nov 03 16:39:04 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:39:04 user nova-compute[74932]:     <video>
Nov 03 16:39:04 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:39:04 user nova-compute[74932]:     </video>
Nov 03 16:39:04 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:39:04 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:39:04 user nova-compute[74932]:     </rng>
Nov 03 16:39:04 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:39:04 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:39:04 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:39:04 user nova-compute[74932]:     </memballoon>
Nov 03 16:39:04 user nova-compute[74932]:   </devices>
Nov 03 16:39:04 user nova-compute[74932]: </domain>
Nov 03 16:39:04 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-131860839',display_name='tempest-AttachVolumeNegativeTest-server-131860839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-131860839',id=31,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXtPTi48w6JLACIuPaWDs/KxmU8xyEMyHRwLIXCz5svrE8D66g9v7n1nLQNFxfEyIkW4e30wb2kWf539pmum3o9NQjQt1K593ijCdAfKBVHHMQrAsbu+HKFoUDk/5FUUw==',key_name='tempest-keypair-1796001998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-gsq20oqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=1d3c17fc-aceb-4974-a312-6d8241fd45ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG os_vif [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a81fafe-6d2f-58c0-817d-148677fbcfd6', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap062ca92a-13, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap062ca92a-13, col_values=(('qos', UUID('8ff04ada-0246-4cac-bceb-4dff97f47b8a')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap062ca92a-13, col_values=(('external_ids', {'iface-id': '062ca92a-1357-4dc6-9899-fe4b4c710d6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:38:70', 'vm-uuid': '1d3c17fc-aceb-4974-a312-6d8241fd45ce'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:04 user nova-compute[74932]: INFO os_vif [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13')
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No VIF found with MAC fa:16:3e:79:38:70, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.neutron [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updated VIF entry in instance network info cache for port 062ca92a-1357-4dc6-9899-fe4b4c710d6b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG nova.network.neutron [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updating instance_info_cache with network_info: [{"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-36e08da5-71f6-4cf1-9866-50eb09cd8959 req-4f636faa-626f-4275-9092-55cc7e34ca58 service nova] Releasing lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-ba19f7e9-551e-455a-be45-f477a013a015 req-717cdc0f-5fb1-4521-92b7-d3d188e1eda5 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ba19f7e9-551e-455a-be45-f477a013a015 req-717cdc0f-5fb1-4521-92b7-d3d188e1eda5 service nova] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ba19f7e9-551e-455a-be45-f477a013a015 req-717cdc0f-5fb1-4521-92b7-d3d188e1eda5 service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ba19f7e9-551e-455a-be45-f477a013a015 req-717cdc0f-5fb1-4521-92b7-d3d188e1eda5 service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-ba19f7e9-551e-455a-be45-f477a013a015 req-717cdc0f-5fb1-4521-92b7-d3d188e1eda5 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] No waiting events found dispatching network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:06 user nova-compute[74932]: WARNING nova.compute.manager [req-ba19f7e9-551e-455a-be45-f477a013a015 req-717cdc0f-5fb1-4521-92b7-d3d188e1eda5 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received unexpected event network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b for instance with vm_state building and task_state spawning.
Nov 03 16:39:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:39:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Instance spawned successfully.
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:39:08 user nova-compute[74932]: INFO nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:39:08 user nova-compute[74932]: INFO nova.compute.manager [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Took 7.33 seconds to build instance.
Nov 03 16:39:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-9c053cee-4df1-40f8-a056-917b13981c4d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.866s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-c5e6a681-9bf8-4389-ab0d-bfc429c75bd3 req-6f7cabab-5b4b-46ba-8c9f-61c278caa841 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5e6a681-9bf8-4389-ab0d-bfc429c75bd3 req-6f7cabab-5b4b-46ba-8c9f-61c278caa841 service nova] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5e6a681-9bf8-4389-ab0d-bfc429c75bd3 req-6f7cabab-5b4b-46ba-8c9f-61c278caa841 service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5e6a681-9bf8-4389-ab0d-bfc429c75bd3 req-6f7cabab-5b4b-46ba-8c9f-61c278caa841 service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-c5e6a681-9bf8-4389-ab0d-bfc429c75bd3 req-6f7cabab-5b4b-46ba-8c9f-61c278caa841 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] No waiting events found dispatching network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:08 user nova-compute[74932]: WARNING nova.compute.manager [req-c5e6a681-9bf8-4389-ab0d-bfc429c75bd3 req-6f7cabab-5b4b-46ba-8c9f-61c278caa841 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received unexpected event network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b for instance with vm_state active and task_state None.
Nov 03 16:39:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-changed-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG nova.compute.manager [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Refreshing instance network info cache due to event network-changed-8f16a496-af41-465a-a478-f5c6f43381c1. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] Acquiring lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] Acquired lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG nova.network.neutron [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Refreshing network info cache for port 8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG nova.network.neutron [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updated VIF entry in instance network info cache for port 8f16a496-af41-465a-a478-f5c6f43381c1. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG nova.network.neutron [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updating instance_info_cache with network_info: [{"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'flavor' on Instance uuid 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8a524923-4407-4336-a3c9-80685ed86131 req-0c8d6177-4fa0-498a-9cbe-009f37b67ce2 service nova] Releasing lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:16 user nova-compute[74932]: INFO nova.compute.manager [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Attaching volume ed6203d2-0fc7-4640-b7c2-9e4f441d33ca to /dev/vdb
Nov 03 16:39:16 user nova-compute[74932]: DEBUG os_brick.utils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[79be5458-1122-495c-93a0-06b1e275d6d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b5995-5376-48ee-8341-985c1ac06dcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef07c30-9eb6-452c-9db1-bddc1ca59dc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e560cd5-76e6-40e1-a4b2-fb918056313a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:39:16 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:39:16 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29a8122-2099-4873-a347-b8c2b03ec808]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG os_brick.utils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:39:16 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updating existing volume attachment record: 0a838e1d-1b1a-4dcb-93ea-ef121e09d558 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:39:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 0d0016ac-ccd0-45b7-936b-ff0da827760b {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 11fb8f0c-e8fc-4248-a522-582a859fca29 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "1ed9acd4-1794-429c-9c37-84a58024947c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "1ed9acd4-1794-429c-9c37-84a58024947c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'flavor' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:26 user nova-compute[74932]: INFO nova.compute.manager [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Attaching volume 790c2a93-130a-4ca6-83ca-72adb933a330 to /dev/vdb
Nov 03 16:39:26 user nova-compute[74932]: DEBUG os_brick.utils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d0fb2-eea7-4960-ab1b-71f2c2c56cd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e9c484-340f-4668-b430-1d64d716d781]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40d2362-d303-48ed-8a5d-9bb285ac41a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c14231c-5b64-48c6-a0b2-73fd281514ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:39:26 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:39:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa665a98-bf1f-4f04-acbf-27e5c94a91ff]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG os_brick.utils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:39:26 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating existing volume attachment record: b885acd2-1867-425c-9c0e-d92b523c88ab {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:39:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:28 user nova-compute[74932]: INFO nova.compute.manager [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Rescuing
Nov 03 16:39:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:28 user nova-compute[74932]: DEBUG nova.network.neutron [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:39:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:29 user nova-compute[74932]: DEBUG nova.network.neutron [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-df46944b-19dc-4f1a-b26a-ac6f26cdab97 req-118b3997-cd5f-46ac-91ce-36e4d57bb310 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-df46944b-19dc-4f1a-b26a-ac6f26cdab97 req-118b3997-cd5f-46ac-91ce-36e4d57bb310 service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-df46944b-19dc-4f1a-b26a-ac6f26cdab97 req-118b3997-cd5f-46ac-91ce-36e4d57bb310 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-df46944b-19dc-4f1a-b26a-ac6f26cdab97 req-118b3997-cd5f-46ac-91ce-36e4d57bb310 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-df46944b-19dc-4f1a-b26a-ac6f26cdab97 req-118b3997-cd5f-46ac-91ce-36e4d57bb310 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:30 user nova-compute[74932]: WARNING nova.compute.manager [req-df46944b-19dc-4f1a-b26a-ac6f26cdab97 req-118b3997-cd5f-46ac-91ce-36e4d57bb310 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state active and task_state rescuing.
Nov 03 16:39:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance destroyed successfully.
Nov 03 16:39:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Attempting a stable device rescue
Nov 03 16:39:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74932) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:39:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Creating image(s)
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "c6e7d69fce0538be872ea416d12a5af794287a3d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "c6e7d69fce0538be872ea416d12a5af794287a3d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-af18c8aa-2b08-4e5b-9bbc-570b9a78ef85 req-e11d9bfc-d9f2-476c-8150-911a17306ac5 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-af18c8aa-2b08-4e5b-9bbc-570b9a78ef85 req-e11d9bfc-d9f2-476c-8150-911a17306ac5 service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-af18c8aa-2b08-4e5b-9bbc-570b9a78ef85 req-e11d9bfc-d9f2-476c-8150-911a17306ac5 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-af18c8aa-2b08-4e5b-9bbc-570b9a78ef85 req-e11d9bfc-d9f2-476c-8150-911a17306ac5 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-af18c8aa-2b08-4e5b-9bbc-570b9a78ef85 req-e11d9bfc-d9f2-476c-8150-911a17306ac5 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:32 user nova-compute[74932]: WARNING nova.compute.manager [req-af18c8aa-2b08-4e5b-9bbc-570b9a78ef85 req-e11d9bfc-d9f2-476c-8150-911a17306ac5 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state active and task_state rescuing.
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG nova.virt.images [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] 24334209-6ba6-4074-991e-11edfd6e1614 was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.part /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.part /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.converted" returned: 0 in 0.346s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:32 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "c6e7d69fce0538be872ea416d12a5af794287a3d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.250s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "c6e7d69fce0538be872ea416d12a5af794287a3d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "c6e7d69fce0538be872ea416d12a5af794287a3d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d,backing_fmt=raw /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c6e7d69fce0538be872ea416d12a5af794287a3d,backing_fmt=raw /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue" returned: 0 in 0.048s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "c6e7d69fce0538be872ea416d12a5af794287a3d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'migration_context' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<4fda841d-fbf5-441b-906c-9cc3b12e6ac1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Start _get_guest_xml network_info=[{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "vif_mac": "fa:16:3e:c5:77:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '24334209-6ba6-4074-991e-11edfd6e1614', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4fda841d-fbf5-441b-906c-9cc3b12e6ac1', 'attached_at': '', 'detached_at': '', 'volume_id': '5206edfc-e197-4e82-ae3a-772043b5e562', 'serial': '5206edfc-e197-4e82-ae3a-772043b5e562'}, 'attachment_id': '3d884dc8-5ecf-4149-b3bd-3dec06955243', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'resources' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<4fda841d-fbf5-441b-906c-9cc3b12e6ac1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'numa_topology' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<4fda841d-fbf5-441b-906c-9cc3b12e6ac1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:39:33 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:33 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<4fda841d-fbf5-441b-906c-9cc3b12e6ac1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:39:33 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:39:33 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:39:33 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ddc02-a232-4858-9c4d-e5a046bee5da]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gXdKtRYC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 16:39:33 user nova-compute[74932]: node.name = iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:39:33 user nova-compute[74932]: node.tpgt = -1
Nov 03 16:39:33 user nova-compute[74932]: node.startup = automatic
Nov 03 16:39:33 user nova-compute[74932]: node.leading_login = No
Nov 03 16:39:33 user nova-compute[74932]: iface.iscsi_ifacename = default
Nov 03 16:39:33 user nova-compute[74932]: iface.net_ifacename = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.ipaddress = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.prefix_len = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.hwaddress = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.transport_name = tcp
Nov 03 16:39:33 user nova-compute[74932]: iface.initiatorname = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.vlan_id = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.vlan_priority = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.vlan_state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.iface_num = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.mtu = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.port = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.bootproto = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.subnet_mask = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.gateway = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_alt_client_id = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_dns = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_learn_iqn = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_vendor_id_state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_vendor_id = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.dhcp_slp_da = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.fragmentation = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.gratuitous_arp = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.incoming_forwarding = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.tos_state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.tos = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.ttl = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.delayed_ack = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.tcp_nagle = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.tcp_wsf_state = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.tcp_wsf = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.tcp_timer_scale = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.tcp_timestamp = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.redirect = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.def_task_mgmt_timeout = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.header_digest = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.data_digest = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.immediate_data = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.initial_r2t = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.data_seq_inorder = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.data_pdu_inorder = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.erl = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.max_receive_data_len = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.first_burst_len = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.max_outstanding_r2t = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.max_burst_len = 0
Nov 03 16:39:33 user nova-compute[74932]: iface.chap_auth = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.bidi_chap = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.strict_login_compliance = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.discovery_auth = <empty>
Nov 03 16:39:33 user nova-compute[74932]: iface.discovery_logout = <empty>
Nov 03 16:39:33 user nova-compute[74932]: node.discovery_address = <empty>
Nov 03 16:39:33 user nova-compute[74932]: node.discovery_port = 0
Nov 03 16:39:33 user nova-compute[74932]: node.discovery_type = static
Nov 03 16:39:33 user nova-compute[74932]: node.session.initial_cmdsn = 0
Nov 03 16:39:33 user nova-compute[74932]: node.session.initial_login_retry_max = 8
Nov 03 16:39:33 user nova-compute[74932]: node.session.xmit_thread_priority = -20
Nov 03 16:39:33 user nova-compute[74932]: node.session.cmds_max = 128
Nov 03 16:39:33 user nova-compute[74932]: node.session.queue_depth = 32
Nov 03 16:39:33 user nova-compute[74932]: node.session.nr_sessions = 1
Nov 03 16:39:33 user nova-compute[74932]: node.session.auth.authmethod = CHAP
Nov 03 16:39:33 user nova-compute[74932]: node.session.auth.username = gXdKtRYC
Nov 03 16:39:33 user nova-compute[74932]: node.session.auth.password = ***
Nov 03 16:39:33 user nova-compute[74932]: node.session.auth.username_in = <empty>
Nov 03 16:39:33 user nova-compute[74932]: node.session.auth.password_in = <empty>
Nov 03 16:39:33 user nova-compute[74932]: node.session.auth.chap_algs = MD5
Nov 03 16:39:33 user nova-compute[74932]: node.session.timeo.replacement_timeout = 120
Nov 03 16:39:33 user nova-compute[74932]: node.session.err_timeo.abort_timeout = 15
Nov 03 16:39:33 user nova-compute[74932]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 16:39:33 user nova-compute[74932]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 16:39:33 user nova-compute[74932]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.FastAbort = Yes
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.InitialR2T = No
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.ImmediateData = Yes
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.MaxConnections = 1
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 16:39:33 user nova-compute[74932]: node.session.iscsi.ERL = 0
Nov 03 16:39:33 user nova-compute[74932]: node.session.scan = manual
Nov 03 16:39:33 user nova-compute[74932]: node.session.reopen_max = 0
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].address = 172.16.0.220
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].port = 3260
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].startup = manual
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].tcp.window_size = 524288
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].tcp.type_of_service = 0
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].timeo.logout_timeout = 15
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].timeo.login_timeout = 15
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].timeo.auth_timeout = 45
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].iscsi.DataDigest = None
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].iscsi.IFMarker = No
Nov 03 16:39:33 user nova-compute[74932]: node.conn[0].iscsi.OFMarker = No
Nov 03 16:39:33 user nova-compute[74932]: # END RECORD
Nov 03 16:39:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd6bbad-808e-41bc-9c77-1619db1642dc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1a5cd5-a5fe-43c8-9f7a-af37e72c4947]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdKtRYC {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdKtRYC" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6428448-140e-438d-8275-2f0db3ea5d1e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXdKtRYC'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f16014-5a64-449c-9ff4-6e94b46c3be9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e83b5-30ec-46dd-8b7c-63316f15c912]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:33 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:33 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:33 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:33 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] HCTL ('33', '0', '0', 0) found on session 25 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b684075a-9641-4586-90e3-e0160b8b66bc]: (4, ('0 0 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching for a device in session 25 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '26535303339623666', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535303339623666', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1372592949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1372592949',id=30,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:38:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-t7m0i33j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:38:20Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=4fda841d-fbf5-441b-906c-9cc3b12e6ac1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "vif_mac": "fa:16:3e:c5:77:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "vif_mac": "fa:16:3e:c5:77:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.objects.base [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<4fda841d-fbf5-441b-906c-9cc3b12e6ac1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:39:33 user nova-compute[74932]:   <uuid>4fda841d-fbf5-441b-906c-9cc3b12e6ac1</uuid>
Nov 03 16:39:33 user nova-compute[74932]:   <name>instance-0000001e</name>
Nov 03 16:39:33 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:39:33 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:39:33 user nova-compute[74932]:   <metadata>
Nov 03 16:39:33 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:39:33 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:39:33 user nova-compute[74932]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1372592949</nova:name>
Nov 03 16:39:33 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:39:33</nova:creationTime>
Nov 03 16:39:33 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:39:33 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:39:33 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:39:33 user nova-compute[74932]:       <nova:owner>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:user uuid="f2fbcaa1d5bb4249b127dcdc0875517a">tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member</nova:user>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:project uuid="5f123f628d784aaaadba9dea7eb71ce2">tempest-ServerBootFromVolumeStableRescueTest-2083155834</nova:project>
Nov 03 16:39:33 user nova-compute[74932]:       </nova:owner>
Nov 03 16:39:33 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:39:33 user nova-compute[74932]:       <nova:ports>
Nov 03 16:39:33 user nova-compute[74932]:         <nova:port uuid="dfb466d0-aa2b-4bb3-b028-740be8874e2b">
Nov 03 16:39:33 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 16:39:33 user nova-compute[74932]:         </nova:port>
Nov 03 16:39:33 user nova-compute[74932]:       </nova:ports>
Nov 03 16:39:33 user nova-compute[74932]:     </nova:instance>
Nov 03 16:39:33 user nova-compute[74932]:   </metadata>
Nov 03 16:39:33 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:39:33 user nova-compute[74932]:     <system>
Nov 03 16:39:33 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:39:33 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:39:33 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:39:33 user nova-compute[74932]:       <entry name="serial">4fda841d-fbf5-441b-906c-9cc3b12e6ac1</entry>
Nov 03 16:39:33 user nova-compute[74932]:       <entry name="uuid">4fda841d-fbf5-441b-906c-9cc3b12e6ac1</entry>
Nov 03 16:39:33 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:39:33 user nova-compute[74932]:     </system>
Nov 03 16:39:33 user nova-compute[74932]:   </sysinfo>
Nov 03 16:39:33 user nova-compute[74932]:   <os>
Nov 03 16:39:33 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:39:33 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:39:33 user nova-compute[74932]:   </os>
Nov 03 16:39:33 user nova-compute[74932]:   <features>
Nov 03 16:39:33 user nova-compute[74932]:     <acpi/>
Nov 03 16:39:33 user nova-compute[74932]:     <apic/>
Nov 03 16:39:33 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:39:33 user nova-compute[74932]:   </features>
Nov 03 16:39:33 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:39:33 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:39:33 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:39:33 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:39:33 user nova-compute[74932]:   </clock>
Nov 03 16:39:33 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:39:33 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:39:33 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:39:33 user nova-compute[74932]:   </cpu>
Nov 03 16:39:33 user nova-compute[74932]:   <devices>
Nov 03 16:39:33 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:39:33 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:39:33 user nova-compute[74932]:       <source dev="/dev/sdb"/>
Nov 03 16:39:33 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:39:33 user nova-compute[74932]:       <serial>5206edfc-e197-4e82-ae3a-772043b5e562</serial>
Nov 03 16:39:33 user nova-compute[74932]:     </disk>
Nov 03 16:39:33 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:39:33 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:39:33 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue"/>
Nov 03 16:39:33 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:39:33 user nova-compute[74932]:       <boot order="1"/>
Nov 03 16:39:33 user nova-compute[74932]:     </disk>
Nov 03 16:39:33 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:39:33 user nova-compute[74932]:       <mac address="fa:16:3e:c5:77:45"/>
Nov 03 16:39:33 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:39:33 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:39:33 user nova-compute[74932]:       <target dev="tapdfb466d0-aa"/>
Nov 03 16:39:33 user nova-compute[74932]:     </interface>
Nov 03 16:39:33 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:39:33 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/console.log" append="off"/>
Nov 03 16:39:33 user nova-compute[74932]:     </serial>
Nov 03 16:39:33 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:39:33 user nova-compute[74932]:     <video>
Nov 03 16:39:33 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:39:33 user nova-compute[74932]:     </video>
Nov 03 16:39:33 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:39:33 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:39:33 user nova-compute[74932]:     </rng>
Nov 03 16:39:33 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:39:33 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:39:33 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:39:33 user nova-compute[74932]:     </memballoon>
Nov 03 16:39:33 user nova-compute[74932]:   </devices>
Nov 03 16:39:33 user nova-compute[74932]: </domain>
Nov 03 16:39:33 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:39:33 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance destroyed successfully.
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No VIF found with MAC fa:16:3e:c5:77:45, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:39:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-0677fb88-6f19-4575-871e-2da958c00fa1 req-192ed91f-9c00-4b25-b2af-d260e229caee service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0677fb88-6f19-4575-871e-2da958c00fa1 req-192ed91f-9c00-4b25-b2af-d260e229caee service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0677fb88-6f19-4575-871e-2da958c00fa1 req-192ed91f-9c00-4b25-b2af-d260e229caee service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0677fb88-6f19-4575-871e-2da958c00fa1 req-192ed91f-9c00-4b25-b2af-d260e229caee service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-0677fb88-6f19-4575-871e-2da958c00fa1 req-192ed91f-9c00-4b25-b2af-d260e229caee service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:35 user nova-compute[74932]: WARNING nova.compute.manager [req-0677fb88-6f19-4575-871e-2da958c00fa1 req-192ed91f-9c00-4b25-b2af-d260e229caee service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state active and task_state rescuing.
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-2a4de8bb-b1c9-4068-b71d-b7b7b672538b req-f65c881b-5d58-4dfe-acb9-9ef6da93025d service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2a4de8bb-b1c9-4068-b71d-b7b7b672538b req-f65c881b-5d58-4dfe-acb9-9ef6da93025d service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2a4de8bb-b1c9-4068-b71d-b7b7b672538b req-f65c881b-5d58-4dfe-acb9-9ef6da93025d service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2a4de8bb-b1c9-4068-b71d-b7b7b672538b req-f65c881b-5d58-4dfe-acb9-9ef6da93025d service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-2a4de8bb-b1c9-4068-b71d-b7b7b672538b req-f65c881b-5d58-4dfe-acb9-9ef6da93025d service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:37 user nova-compute[74932]: WARNING nova.compute.manager [req-2a4de8bb-b1c9-4068-b71d-b7b7b672538b req-f65c881b-5d58-4dfe-acb9-9ef6da93025d service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state active and task_state rescuing.
Nov 03 16:39:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-5cdd4c7b-a515-48a9-9e6c-88eb1847f5b4 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:39:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxyFMpew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:39:45 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:39:45 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:39:45 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcce9212-6c7f-426a-869c-d57e24f7d14b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:39:45 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8603d647-c09e-4cbb-803d-1aa37ba0ad81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca] added
Nov 03 16:39:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a089bc2-04bb-4544-a2bd-e0f5d731850c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[00159e24-b339-41aa-a887-2afb872a79dc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxyFMpew {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxyFMpew" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238f1bc-5ff3-4717-8e37-b01b75e5d0ec]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sxyFMpew'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[383febc8-9f7e-444d-9015-4f54d091e9be]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc14d8-fa2d-43cd-a93c-759103139a27]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff1e2c-52a6-471f-b9b2-3c701fb4b834]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260]
Nov 03 16:39:45 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260] successful.
Nov 03 16:39:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885ad9b-02f4-47b2-a2bb-6f05d2f9a54d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f391e-d248-47a9-8099-5033d6a5b541]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:39:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:45 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:39:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[56659a27-9fca-48cf-8701-afea640cddfe]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:39:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxyFMpew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:39:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:39:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23132323435623331', 'path': '/dev/sdg'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:39:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132323435623331', 'path': '/dev/sdg'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:39:46 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'flavor' on Instance uuid 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:39:46 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:39:46 user nova-compute[74932]:   <source dev="/dev/sdg"/>
Nov 03 16:39:46 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:39:46 user nova-compute[74932]:   <serial>ed6203d2-0fc7-4640-b7c2-9e4f441d33ca</serial>
Nov 03 16:39:46 user nova-compute[74932]: </disk>
Nov 03 16:39:46 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] No VIF found with MAC fa:16:3e:c2:ac:f3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b63aabc5-9308-422e-ad7b-212217ee54cf tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.744s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 22.171s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:39:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:51 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:52 user nova-compute[74932]: INFO nova.compute.manager [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Detaching volume ed6203d2-0fc7-4640-b7c2-9e4f441d33ca
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:39:52 user nova-compute[74932]: INFO nova.compute.claims [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Claim successful on node user
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:52 user nova-compute[74932]: INFO nova.virt.block_device [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Attempting to driver detach volume ed6203d2-0fc7-4640-b7c2-9e4f441d33ca from mountpoint /dev/vdb
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Attempting to detach device vdb from instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:39:52 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:39:52 user nova-compute[74932]:   <source dev="/dev/sdg"/>
Nov 03 16:39:52 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:39:52 user nova-compute[74932]:   <serial>ed6203d2-0fc7-4640-b7c2-9e4f441d33ca</serial>
Nov 03 16:39:52 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:39:52 user nova-compute[74932]: </disk>
Nov 03 16:39:52 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:39:52 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully detached device vdb from instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd from the persistent domain config.
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:39:52 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:39:52 user nova-compute[74932]:   <source dev="/dev/sdg"/>
Nov 03 16:39:52 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:39:52 user nova-compute[74932]:   <serial>ed6203d2-0fc7-4640-b7c2-9e4f441d33ca</serial>
Nov 03 16:39:52 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:39:52 user nova-compute[74932]: </disk>
Nov 03 16:39:52 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsDKMySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:39:52 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:39:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:39:52 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:39:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:39:52 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d84773-e0d4-4230-b1d1-c49e274491b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:39:52 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:52 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[141447a9-c879-452b-85a3-5b3580aa6f8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330] added
Nov 03 16:39:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c64eef-5b8e-45dd-9265-2ae22ca33390]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[653ba7c7-941b-4b81-9494-0fd8771c4a95]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsDKMySd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsDKMySd" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f554868b-2162-40c0-aabf-3195264ee082]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsDKMySd'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8b2a9c-2394-4169-9235-e2e7e323709d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a43cf7-dae3-48cc-8278-5c2fd9dfe269]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:39:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:39:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130d026-533e-45fa-bf17-d77ce02b1722]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260]
Nov 03 16:39:53 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260] successful.
Nov 03 16:39:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[172194f1-4b0b-4019-8312-c1eb98fe484f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c9e8c8-9087-4c21-9888-cfa1177b8708]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:39:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deba7c3c-334f-46f9-b009-737038c70dae (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d984ef8e-77a5-4c6b-951f-4f2c8bd9454f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f86659-88cd-4378-a32d-bee27dcd168f (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:39:53 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:39:53 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc34f8-b9b3-4918-a22f-e1ca5391fcb0]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsDKMySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:39:53 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.policy [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '462c0b16a5f744e49b3ee3ef8ee39e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1f1557f72d4ca1ac1d34772c23a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:39:53 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Creating image(s)
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.285s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '26638643933353964', 'path': '/dev/sdh'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643933353964', 'path': '/dev/sdh'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'flavor' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:39:54 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:39:54 user nova-compute[74932]:   <source dev="/dev/sdh"/>
Nov 03 16:39:54 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:39:54 user nova-compute[74932]:   <serial>790c2a93-130a-4ca6-83ca-72adb933a330</serial>
Nov 03 16:39:54 user nova-compute[74932]: </disk>
Nov 03 16:39:54 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.301s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk 1073741824" returned: 0 in 0.066s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.282s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:39:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Cannot resize image /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Ensure instance console log exists: /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No VIF found with MAC fa:16:3e:a1:c5:2e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Successfully created port: 3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:39:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4cf5ef48-3459-4fec-997e-d21192d5f555 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.973s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Successfully updated port: 3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing instance network info cache due to event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance network_info: |[{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Start _get_guest_xml network_info=[{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:39:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:56 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-172897330',display_name='tempest-ServerRescueNegativeTestJSON-server-172897330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-172897330',id=32,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwyl71SkI69ufpiaDKKLYxWe0GV/IiYZYNRQC1KWGqgNr1y0Ycm5ZB3Z4cgBiUc128vQsYz17MojxO3lADHJNNYkd6mvQ5eRIIaDYD08kkSfOxaUH6iCopGtZrxkBf0XQ==',key_name='tempest-keypair-425901354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-33le1rv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=77b76574-4898-49f8-aaee-cff8f7e11b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.objects.instance [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'pci_devices' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:39:56 user nova-compute[74932]:   <uuid>77b76574-4898-49f8-aaee-cff8f7e11b6e</uuid>
Nov 03 16:39:56 user nova-compute[74932]:   <name>instance-00000020</name>
Nov 03 16:39:56 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:39:56 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:39:56 user nova-compute[74932]:   <metadata>
Nov 03 16:39:56 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:39:56 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:39:56 user nova-compute[74932]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-172897330</nova:name>
Nov 03 16:39:56 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:39:56</nova:creationTime>
Nov 03 16:39:56 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:39:56 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:39:56 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:39:56 user nova-compute[74932]:       <nova:owner>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:user uuid="462c0b16a5f744e49b3ee3ef8ee39e00">tempest-ServerRescueNegativeTestJSON-1518505179-project-member</nova:user>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:project uuid="dd1f1557f72d4ca1ac1d34772c23a953">tempest-ServerRescueNegativeTestJSON-1518505179</nova:project>
Nov 03 16:39:56 user nova-compute[74932]:       </nova:owner>
Nov 03 16:39:56 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:39:56 user nova-compute[74932]:       <nova:ports>
Nov 03 16:39:56 user nova-compute[74932]:         <nova:port uuid="3e54265e-4ed1-4af7-85d6-033ddbae3b7b">
Nov 03 16:39:56 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 16:39:56 user nova-compute[74932]:         </nova:port>
Nov 03 16:39:56 user nova-compute[74932]:       </nova:ports>
Nov 03 16:39:56 user nova-compute[74932]:     </nova:instance>
Nov 03 16:39:56 user nova-compute[74932]:   </metadata>
Nov 03 16:39:56 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:39:56 user nova-compute[74932]:     <system>
Nov 03 16:39:56 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:39:56 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:39:56 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:39:56 user nova-compute[74932]:       <entry name="serial">77b76574-4898-49f8-aaee-cff8f7e11b6e</entry>
Nov 03 16:39:56 user nova-compute[74932]:       <entry name="uuid">77b76574-4898-49f8-aaee-cff8f7e11b6e</entry>
Nov 03 16:39:56 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:39:56 user nova-compute[74932]:     </system>
Nov 03 16:39:56 user nova-compute[74932]:   </sysinfo>
Nov 03 16:39:56 user nova-compute[74932]:   <os>
Nov 03 16:39:56 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:39:56 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:39:56 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:39:56 user nova-compute[74932]:   </os>
Nov 03 16:39:56 user nova-compute[74932]:   <features>
Nov 03 16:39:56 user nova-compute[74932]:     <acpi/>
Nov 03 16:39:56 user nova-compute[74932]:     <apic/>
Nov 03 16:39:56 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:39:56 user nova-compute[74932]:   </features>
Nov 03 16:39:56 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:39:56 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:39:56 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:39:56 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:39:56 user nova-compute[74932]:   </clock>
Nov 03 16:39:56 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:39:56 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:39:56 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:39:56 user nova-compute[74932]:   </cpu>
Nov 03 16:39:56 user nova-compute[74932]:   <devices>
Nov 03 16:39:56 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:39:56 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:39:56 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk"/>
Nov 03 16:39:56 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:39:56 user nova-compute[74932]:     </disk>
Nov 03 16:39:56 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:39:56 user nova-compute[74932]:       <mac address="fa:16:3e:c4:0a:af"/>
Nov 03 16:39:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:39:56 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:39:56 user nova-compute[74932]:       <target dev="tap3e54265e-4e"/>
Nov 03 16:39:56 user nova-compute[74932]:     </interface>
Nov 03 16:39:56 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:39:56 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/console.log" append="off"/>
Nov 03 16:39:56 user nova-compute[74932]:     </serial>
Nov 03 16:39:56 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:39:56 user nova-compute[74932]:     <video>
Nov 03 16:39:56 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:39:56 user nova-compute[74932]:     </video>
Nov 03 16:39:56 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:39:56 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:39:56 user nova-compute[74932]:     </rng>
Nov 03 16:39:56 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:39:56 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:39:56 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:39:56 user nova-compute[74932]:     </memballoon>
Nov 03 16:39:56 user nova-compute[74932]:   </devices>
Nov 03 16:39:56 user nova-compute[74932]: </domain>
Nov 03 16:39:56 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-172897330',display_name='tempest-ServerRescueNegativeTestJSON-server-172897330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-172897330',id=32,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwyl71SkI69ufpiaDKKLYxWe0GV/IiYZYNRQC1KWGqgNr1y0Ycm5ZB3Z4cgBiUc128vQsYz17MojxO3lADHJNNYkd6mvQ5eRIIaDYD08kkSfOxaUH6iCopGtZrxkBf0XQ==',key_name='tempest-keypair-425901354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-33le1rv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=77b76574-4898-49f8-aaee-cff8f7e11b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG os_vif [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cb538d4-1e28-5454-bc43-e4d237b71ce1', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e54265e-4e, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e54265e-4e, col_values=(('qos', UUID('bedf8210-283c-4565-8a9e-e1b60f89bc1e')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e54265e-4e, col_values=(('external_ids', {'iface-id': '3e54265e-4ed1-4af7-85d6-033ddbae3b7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:0a:af', 'vm-uuid': '77b76574-4898-49f8-aaee-cff8f7e11b6e'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:57 user nova-compute[74932]: INFO os_vif [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e')
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:c4:0a:af, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:39:57 user nova-compute[74932]: INFO nova.compute.manager [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Rescuing
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updated VIF entry in instance network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-501f80b3-454b-46e7-9cdd-694cc2c19669 req-256f447c-dcd1-4fba-b623-9a0bd6eaf36e service nova] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:39:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-d2fc296e-51a0-4cc5-a6c7-2f79864f8f76 req-43677094-ce5a-42dd-9387-64a118b47421 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d2fc296e-51a0-4cc5-a6c7-2f79864f8f76 req-43677094-ce5a-42dd-9387-64a118b47421 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d2fc296e-51a0-4cc5-a6c7-2f79864f8f76 req-43677094-ce5a-42dd-9387-64a118b47421 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d2fc296e-51a0-4cc5-a6c7-2f79864f8f76 req-43677094-ce5a-42dd-9387-64a118b47421 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-d2fc296e-51a0-4cc5-a6c7-2f79864f8f76 req-43677094-ce5a-42dd-9387-64a118b47421 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:58 user nova-compute[74932]: WARNING nova.compute.manager [req-d2fc296e-51a0-4cc5-a6c7-2f79864f8f76 req-43677094-ce5a-42dd-9387-64a118b47421 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state active and task_state rescuing.
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f800e30-3806-4540-954e-78830dbeb247 req-0208349b-48af-476d-b9fa-5e3659b4349b service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f800e30-3806-4540-954e-78830dbeb247 req-0208349b-48af-476d-b9fa-5e3659b4349b service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f800e30-3806-4540-954e-78830dbeb247 req-0208349b-48af-476d-b9fa-5e3659b4349b service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f800e30-3806-4540-954e-78830dbeb247 req-0208349b-48af-476d-b9fa-5e3659b4349b service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f800e30-3806-4540-954e-78830dbeb247 req-0208349b-48af-476d-b9fa-5e3659b4349b service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:39:58 user nova-compute[74932]: WARNING nova.compute.manager [req-1f800e30-3806-4540-954e-78830dbeb247 req-0208349b-48af-476d-b9fa-5e3659b4349b service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state building and task_state spawning.
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:39:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance destroyed successfully.
Nov 03 16:39:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Attempting a stable device rescue
Nov 03 16:39:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74932) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 16:39:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:39:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Creating image(s)
Nov 03 16:39:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:39:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:39:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'trusted_certs' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:39:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "a7597ddc4063a08db5e9d6b5949b54d8f030373b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:39:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "a7597ddc4063a08db5e9d6b5949b54d8f030373b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-64466303-e7c3-44c9-9937-fc2dfdde2655 req-0db08aa4-716b-4128-81c8-5b5c119d3645 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-64466303-e7c3-44c9-9937-fc2dfdde2655 req-0db08aa4-716b-4128-81c8-5b5c119d3645 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-64466303-e7c3-44c9-9937-fc2dfdde2655 req-0db08aa4-716b-4128-81c8-5b5c119d3645 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-64466303-e7c3-44c9-9937-fc2dfdde2655 req-0db08aa4-716b-4128-81c8-5b5c119d3645 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-64466303-e7c3-44c9-9937-fc2dfdde2655 req-0db08aa4-716b-4128-81c8-5b5c119d3645 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:40:00 user nova-compute[74932]: WARNING nova.compute.manager [req-64466303-e7c3-44c9-9937-fc2dfdde2655 req-0db08aa4-716b-4128-81c8-5b5c119d3645 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state active and task_state rescuing.
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.part --force-share --output=json" returned: 0 in 0.276s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG nova.virt.images [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] e9234f17-7974-4f1e-8ebb-ee2213f34587 was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.part /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-51a68d63-c857-46cc-a105-40479a178883 req-fae0caa4-00b6-4986-a352-6e4060547c39 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-51a68d63-c857-46cc-a105-40479a178883 req-fae0caa4-00b6-4986-a352-6e4060547c39 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-51a68d63-c857-46cc-a105-40479a178883 req-fae0caa4-00b6-4986-a352-6e4060547c39 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-51a68d63-c857-46cc-a105-40479a178883 req-fae0caa4-00b6-4986-a352-6e4060547c39 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-51a68d63-c857-46cc-a105-40479a178883 req-fae0caa4-00b6-4986-a352-6e4060547c39 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:40:01 user nova-compute[74932]: WARNING nova.compute.manager [req-51a68d63-c857-46cc-a105-40479a178883 req-fae0caa4-00b6-4986-a352-6e4060547c39 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state building and task_state spawning.
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.part /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.converted" returned: 0 in 0.410s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "a7597ddc4063a08db5e9d6b5949b54d8f030373b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.027s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "a7597ddc4063a08db5e9d6b5949b54d8f030373b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "a7597ddc4063a08db5e9d6b5949b54d8f030373b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b --force-share --output=json" returned: 0 in 0.238s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b,backing_fmt=raw /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7597ddc4063a08db5e9d6b5949b54d8f030373b,backing_fmt=raw /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue" returned: 0 in 0.083s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "a7597ddc4063a08db5e9d6b5949b54d8f030373b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.instance [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'migration_context' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:01 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance spawned successfully.
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Object Instance<f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Start _get_guest_xml network_info=[{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "vif_mac": "fa:16:3e:a1:c5:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9234f17-7974-4f1e-8ebb-ee2213f34587', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsDKMySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16', 'attached_at': '', 'detached_at': '', 'volume_id': '790c2a93-130a-4ca6-83ca-72adb933a330', 'serial': '790c2a93-130a-4ca6-83ca-72adb933a330'}, 'attachment_id': 'b885acd2-1867-425c-9c0e-d92b523c88ab', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.instance [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'resources' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Object Instance<f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.instance [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'numa_topology' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Object Instance<f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:40:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:40:01 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.instance [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'vcpu_model' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.objects.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Object Instance<f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsDKMySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:40:01 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:40:01 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:40:01 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:40:01 user nova-compute[74932]: INFO nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 03 16:40:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[814514d8-68c5-4d92-87e4-23263b0e0074]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EsDKMySd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 16:40:01 user nova-compute[74932]: node.name = iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330
Nov 03 16:40:01 user nova-compute[74932]: node.tpgt = -1
Nov 03 16:40:01 user nova-compute[74932]: node.startup = automatic
Nov 03 16:40:01 user nova-compute[74932]: node.leading_login = No
Nov 03 16:40:01 user nova-compute[74932]: iface.iscsi_ifacename = default
Nov 03 16:40:01 user nova-compute[74932]: iface.net_ifacename = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.ipaddress = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.prefix_len = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.hwaddress = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.transport_name = tcp
Nov 03 16:40:01 user nova-compute[74932]: iface.initiatorname = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.vlan_id = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.vlan_priority = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.vlan_state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.iface_num = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.mtu = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.port = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.bootproto = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.subnet_mask = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.gateway = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_alt_client_id = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_dns = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_learn_iqn = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_vendor_id_state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_vendor_id = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.dhcp_slp_da = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.fragmentation = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.gratuitous_arp = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.incoming_forwarding = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.tos_state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.tos = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.ttl = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.delayed_ack = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.tcp_nagle = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.tcp_wsf_state = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.tcp_wsf = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.tcp_timer_scale = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.tcp_timestamp = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.redirect = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.def_task_mgmt_timeout = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.header_digest = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.data_digest = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.immediate_data = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.initial_r2t = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.data_seq_inorder = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.data_pdu_inorder = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.erl = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.max_receive_data_len = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.first_burst_len = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.max_outstanding_r2t = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.max_burst_len = 0
Nov 03 16:40:01 user nova-compute[74932]: iface.chap_auth = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.bidi_chap = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.strict_login_compliance = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.discovery_auth = <empty>
Nov 03 16:40:01 user nova-compute[74932]: iface.discovery_logout = <empty>
Nov 03 16:40:01 user nova-compute[74932]: node.discovery_address = <empty>
Nov 03 16:40:01 user nova-compute[74932]: node.discovery_port = 0
Nov 03 16:40:01 user nova-compute[74932]: node.discovery_type = static
Nov 03 16:40:01 user nova-compute[74932]: node.session.initial_cmdsn = 0
Nov 03 16:40:01 user nova-compute[74932]: node.session.initial_login_retry_max = 8
Nov 03 16:40:01 user nova-compute[74932]: node.session.xmit_thread_priority = -20
Nov 03 16:40:01 user nova-compute[74932]: node.session.cmds_max = 128
Nov 03 16:40:01 user nova-compute[74932]: node.session.queue_depth = 32
Nov 03 16:40:01 user nova-compute[74932]: node.session.nr_sessions = 1
Nov 03 16:40:01 user nova-compute[74932]: node.session.auth.authmethod = CHAP
Nov 03 16:40:01 user nova-compute[74932]: node.session.auth.username = EsDKMySd
Nov 03 16:40:01 user nova-compute[74932]: node.session.auth.password = ***
Nov 03 16:40:01 user nova-compute[74932]: node.session.auth.username_in = <empty>
Nov 03 16:40:01 user nova-compute[74932]: node.session.auth.password_in = <empty>
Nov 03 16:40:01 user nova-compute[74932]: node.session.auth.chap_algs = MD5
Nov 03 16:40:01 user nova-compute[74932]: node.session.timeo.replacement_timeout = 120
Nov 03 16:40:01 user nova-compute[74932]: node.session.err_timeo.abort_timeout = 15
Nov 03 16:40:01 user nova-compute[74932]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 16:40:01 user nova-compute[74932]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 16:40:01 user nova-compute[74932]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.FastAbort = Yes
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.InitialR2T = No
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.ImmediateData = Yes
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.MaxConnections = 1
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 16:40:01 user nova-compute[74932]: node.session.iscsi.ERL = 0
Nov 03 16:40:01 user nova-compute[74932]: node.session.scan = manual
Nov 03 16:40:01 user nova-compute[74932]: node.session.reopen_max = 0
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].address = 172.16.0.220
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].port = 3260
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].startup = manual
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].tcp.window_size = 524288
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].tcp.type_of_service = 0
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].timeo.logout_timeout = 15
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].timeo.login_timeout = 15
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].timeo.auth_timeout = 45
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].iscsi.DataDigest = None
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].iscsi.IFMarker = No
Nov 03 16:40:01 user nova-compute[74932]: node.conn[0].iscsi.OFMarker = No
Nov 03 16:40:01 user nova-compute[74932]: # END RECORD
Nov 03 16:40:01 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: INFO nova.compute.manager [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Took 9.31 seconds to build instance.
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0d712-55cc-476b-8ecf-814c3f0d9200]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1a92dc41-7155-478f-9423-1879bb7b27cc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.931s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1898c352-44b1-419e-a246-cfd65684f0f4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsDKMySd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsDKMySd" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab753580-9418-487b-bf02-76d456dcab95]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsDKMySd'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[43836345-dd9a-47e2-8021-30d688fd83ad]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f82ffea-6389-45e3-a802-15183cb937e3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:40:02 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:40:02 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:40:02 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:40:02 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:40:02 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:40:02 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:40:02 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:40:02 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.200s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] HCTL ('39', '0', '0', 0) found on session 31 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8444d53-5526-4ff7-be1f-70b17a77ffef]: (4, ('0 0 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Searching for a device in session 31 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsDKMySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.225s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] <== connect_volume: return (226ms) {'type': 'block', 'scsi_wwn': '26638643933353964', 'path': '/dev/sdh'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643933353964', 'path': '/dev/sdh'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1558430644',display_name='tempest-ServerStableDeviceRescueTest-server-1558430644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1558430644',id=27,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOfnjxg1k3RnokJ4NfBnrK/mCaj28IuLgVS3j/qIcWiUnTJpvcQ+uVs1nHFqCd0jvtrSIQq6p/ff5t/X/f1lnz1UmiXu8t29wfw9LnfbTcubbeJTpTDglgAw9x/hp9/wg==',key_name='tempest-keypair-22406688',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:35:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='708c7a9d408f4b6e9300246c0bd84f73',ramdisk_id='',reservation_id='r-30ezqyyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-40984610',owner_user_name='tempest-ServerStableDeviceRescueTest-40984610-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72961e6dbb884091a9b3fa92da558ef4',uuid=f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "vif_mac": "fa:16:3e:a1:c5:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converting VIF {"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "vif_mac": "fa:16:3e:a1:c5:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.objects.instance [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'pci_devices' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.objects.base [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Object Instance<f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:40:02 user nova-compute[74932]:   <uuid>f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16</uuid>
Nov 03 16:40:02 user nova-compute[74932]:   <name>instance-0000001b</name>
Nov 03 16:40:02 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:40:02 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:40:02 user nova-compute[74932]:   <metadata>
Nov 03 16:40:02 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:40:02 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:40:02 user nova-compute[74932]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1558430644</nova:name>
Nov 03 16:40:02 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:40:01</nova:creationTime>
Nov 03 16:40:02 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:40:02 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:40:02 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:40:02 user nova-compute[74932]:       <nova:owner>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:user uuid="72961e6dbb884091a9b3fa92da558ef4">tempest-ServerStableDeviceRescueTest-40984610-project-member</nova:user>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:project uuid="708c7a9d408f4b6e9300246c0bd84f73">tempest-ServerStableDeviceRescueTest-40984610</nova:project>
Nov 03 16:40:02 user nova-compute[74932]:       </nova:owner>
Nov 03 16:40:02 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:40:02 user nova-compute[74932]:       <nova:ports>
Nov 03 16:40:02 user nova-compute[74932]:         <nova:port uuid="2002e939-5f21-48cf-8aae-7868f7c6992a">
Nov 03 16:40:02 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 16:40:02 user nova-compute[74932]:         </nova:port>
Nov 03 16:40:02 user nova-compute[74932]:       </nova:ports>
Nov 03 16:40:02 user nova-compute[74932]:     </nova:instance>
Nov 03 16:40:02 user nova-compute[74932]:   </metadata>
Nov 03 16:40:02 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:40:02 user nova-compute[74932]:     <system>
Nov 03 16:40:02 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:40:02 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:40:02 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:40:02 user nova-compute[74932]:       <entry name="serial">f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16</entry>
Nov 03 16:40:02 user nova-compute[74932]:       <entry name="uuid">f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16</entry>
Nov 03 16:40:02 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:40:02 user nova-compute[74932]:     </system>
Nov 03 16:40:02 user nova-compute[74932]:   </sysinfo>
Nov 03 16:40:02 user nova-compute[74932]:   <os>
Nov 03 16:40:02 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:40:02 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:40:02 user nova-compute[74932]:   </os>
Nov 03 16:40:02 user nova-compute[74932]:   <features>
Nov 03 16:40:02 user nova-compute[74932]:     <acpi/>
Nov 03 16:40:02 user nova-compute[74932]:     <apic/>
Nov 03 16:40:02 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:40:02 user nova-compute[74932]:   </features>
Nov 03 16:40:02 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:40:02 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:40:02 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:40:02 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:40:02 user nova-compute[74932]:   </clock>
Nov 03 16:40:02 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:40:02 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:40:02 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:40:02 user nova-compute[74932]:   </cpu>
Nov 03 16:40:02 user nova-compute[74932]:   <devices>
Nov 03 16:40:02 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:40:02 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:40:02 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk"/>
Nov 03 16:40:02 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:40:02 user nova-compute[74932]:     </disk>
Nov 03 16:40:02 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:40:02 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:40:02 user nova-compute[74932]:       <source dev="/dev/sdh"/>
Nov 03 16:40:02 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:40:02 user nova-compute[74932]:       <serial>790c2a93-130a-4ca6-83ca-72adb933a330</serial>
Nov 03 16:40:02 user nova-compute[74932]:     </disk>
Nov 03 16:40:02 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:40:02 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:40:02 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue"/>
Nov 03 16:40:02 user nova-compute[74932]:       <target dev="vdc" bus="virtio"/>
Nov 03 16:40:02 user nova-compute[74932]:       <boot order="1"/>
Nov 03 16:40:02 user nova-compute[74932]:     </disk>
Nov 03 16:40:02 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:40:02 user nova-compute[74932]:       <mac address="fa:16:3e:a1:c5:2e"/>
Nov 03 16:40:02 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:40:02 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:40:02 user nova-compute[74932]:       <target dev="tap2002e939-5f"/>
Nov 03 16:40:02 user nova-compute[74932]:     </interface>
Nov 03 16:40:02 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:40:02 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/console.log" append="off"/>
Nov 03 16:40:02 user nova-compute[74932]:     </serial>
Nov 03 16:40:02 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:40:02 user nova-compute[74932]:     <video>
Nov 03 16:40:02 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:40:02 user nova-compute[74932]:     </video>
Nov 03 16:40:02 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:40:02 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:40:02 user nova-compute[74932]:     </rng>
Nov 03 16:40:02 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:40:02 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:40:02 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:40:02 user nova-compute[74932]:     </memballoon>
Nov 03 16:40:02 user nova-compute[74932]:   </devices>
Nov 03 16:40:02 user nova-compute[74932]: </domain>
Nov 03 16:40:02 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:40:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance destroyed successfully.
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] No VIF found with MAC fa:16:3e:a1:c5:2e, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json" returned: 0 in 0.280s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-13f9da29-8836-4d10-8372-45366f2f45cb req-d0eb5a6a-9084-4ad0-923c-1c4ebda330a9 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-13f9da29-8836-4d10-8372-45366f2f45cb req-d0eb5a6a-9084-4ad0-923c-1c4ebda330a9 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-13f9da29-8836-4d10-8372-45366f2f45cb req-d0eb5a6a-9084-4ad0-923c-1c4ebda330a9 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-13f9da29-8836-4d10-8372-45366f2f45cb req-d0eb5a6a-9084-4ad0-923c-1c4ebda330a9 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-13f9da29-8836-4d10-8372-45366f2f45cb req-d0eb5a6a-9084-4ad0-923c-1c4ebda330a9 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:40:04 user nova-compute[74932]: WARNING nova.compute.manager [req-13f9da29-8836-4d10-8372-45366f2f45cb req-d0eb5a6a-9084-4ad0-923c-1c4ebda330a9 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state active and task_state rescuing.
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:40:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-853c9d50-35c0-4584-aba7-e7d19c004d94 req-c5c0c2fe-8645-46ac-b28a-8e256f74fc28 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-853c9d50-35c0-4584-aba7-e7d19c004d94 req-c5c0c2fe-8645-46ac-b28a-8e256f74fc28 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-853c9d50-35c0-4584-aba7-e7d19c004d94 req-c5c0c2fe-8645-46ac-b28a-8e256f74fc28 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-853c9d50-35c0-4584-aba7-e7d19c004d94 req-c5c0c2fe-8645-46ac-b28a-8e256f74fc28 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-853c9d50-35c0-4584-aba7-e7d19c004d94 req-c5c0c2fe-8645-46ac-b28a-8e256f74fc28 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:40:06 user nova-compute[74932]: WARNING nova.compute.manager [req-853c9d50-35c0-4584-aba7-e7d19c004d94 req-c5c0c2fe-8645-46ac-b28a-8e256f74fc28 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state active and task_state rescuing.
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-698f25b7-e806-4287-a0a7-fdb2b3b35e7f tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:07 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:40:07 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=23.87842559814453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5aa105d4-e07c-48aa-8931-528c4c924e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:40:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.768s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd is timed out.
Nov 03 16:40:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully detached device vdb from instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd from the live domain config.
Nov 03 16:40:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxyFMpew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:40:13 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[feed9a60-8f9b-441d-b9ed-ad0722db3c5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:40:13 user nova-compute[74932]: No targets found.
Nov 03 16:40:13 user nova-compute[74932]: iSNS:
Nov 03 16:40:13 user nova-compute[74932]: No targets found.
Nov 03 16:40:13 user nova-compute[74932]: STATIC:
Nov 03 16:40:13 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330
Nov 03 16:40:13 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:40:13 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:40:13 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:40:13 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:40:13 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:40:13 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e
Nov 03 16:40:13 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:40:13 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:40:13 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca
Nov 03 16:40:13 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:40:13 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:40:13 user nova-compute[74932]: FIRMWARE:
Nov 03 16:40:13 user nova-compute[74932]: No targets found.
Nov 03 16:40:13 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:40:13 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:40:13 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[973634e2-9817-4c73-ae34-b8be9f7d7e6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42fa925-32a9-4906-a187-0da0e172793e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:40:13 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:40:13 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:40:13 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:40:13 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:40:13 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:40:13 user nova-compute[74932]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca (non-flash)
Nov 03 16:40:13 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:40:13 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8410e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca'): ({'sdg'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Removing single pathed devices sdg {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acde6f9-aa62-4f51-b76c-2f555b073e0c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f99757d-babd-417a-9ff1-0555ea4cad4e]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Flushing IO for device /dev/sdg {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc4b0a-d440-4b35-9bac-0e90d8ecbb44]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e27f61-d976-4055-9d2c-a70704791ad1]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] SCSI volumes sdg have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[98436059-46d3-4db0-96a3-29b9ec6e892c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e3b6e-ebd2-4cd5-8bc1-ed264e43944d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260]
Nov 03 16:40:13 user nova-compute[74932]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca, portal: 172.16.0.220,3260] successful.
Nov 03 16:40:13 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed6203d2-0fc7-4640-b7c2-9e4f441d33ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125cc9c-6852-4d27-ad79-3bc8fefa5779]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] <== disconnect_volume: return (347ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:40:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:40:14 user nova-compute[74932]: DEBUG nova.objects.instance [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'flavor' on Instance uuid 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-64b9d7a9-8549-413c-a3ca-318dae539d29 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.179s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-changed-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Refreshing instance network info cache due to event network-changed-8f16a496-af41-465a-a478-f5c6f43381c1. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] Acquiring lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] Acquired lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG nova.network.neutron [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Refreshing network info cache for port 8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:43 user nova-compute[74932]: INFO nova.compute.manager [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Terminating instance
Nov 03 16:40:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-69e7bc8b-c0cd-4ef9-b64c-98b7e9f37872 req-45d7308d-7cf6-4d01-a600-52ef7e67e5d0 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-vif-unplugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69e7bc8b-c0cd-4ef9-b64c-98b7e9f37872 req-45d7308d-7cf6-4d01-a600-52ef7e67e5d0 service nova] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69e7bc8b-c0cd-4ef9-b64c-98b7e9f37872 req-45d7308d-7cf6-4d01-a600-52ef7e67e5d0 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69e7bc8b-c0cd-4ef9-b64c-98b7e9f37872 req-45d7308d-7cf6-4d01-a600-52ef7e67e5d0 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-69e7bc8b-c0cd-4ef9-b64c-98b7e9f37872 req-45d7308d-7cf6-4d01-a600-52ef7e67e5d0 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] No waiting events found dispatching network-vif-unplugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-69e7bc8b-c0cd-4ef9-b64c-98b7e9f37872 req-45d7308d-7cf6-4d01-a600-52ef7e67e5d0 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-vif-unplugged-8f16a496-af41-465a-a478-f5c6f43381c1 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updated VIF entry in instance network info cache for port 8f16a496-af41-465a-a478-f5c6f43381c1. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.network.neutron [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updating instance_info_cache with network_info: [{"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-651acc4b-ed19-44ba-b24a-ca32a67cb798 req-d4f47581-c974-4123-97de-f89d8c7993aa service nova] Releasing lock "refresh_cache-840e5d07-c2f2-40b3-b05a-23bd8acf56bd" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:40:44 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Instance destroyed successfully.
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.objects.instance [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'resources' on Instance uuid 840e5d07-c2f2-40b3-b05a-23bd8acf56bd {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-201867260',display_name='tempest-TestStampPattern-server-201867260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-201867260',id=29,image_ref='b37f05e8-bf67-4229-8ba8-4fb65b55423a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMj9AIFIKO0NgK0zkHn0Jy+l3mgfcxgiBUpQw/9Yol77VWUT8u3eYfCI0rb+RgkX7v+WG5SHkNUka8piM/z+1zFyCPRyze8JQydhtJPBVujfoF47Ahsa+Vb6gz5xkxMaw==',key_name='tempest-TestStampPattern-1337686481',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c887cbc267d40dd9e270a25f6baf66f',ramdisk_id='',reservation_id='r-8z9m5rip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ad86cdd7-1253-4246-ac62-32c4898b30df',image_min_disk='1',image_min_ram='0',image_owner_id='2c887cbc267d40dd9e270a25f6baf66f',image_owner_project_name='tempest-TestStampPattern-1606523677',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1606523677-project-member',image_user_id='99403819bf9845ac85cf9ff73a492507',owner_project_name='tempest-TestStampPattern-1606523677',owner_user_name='tempest-TestStampPattern-1606523677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:37:32Z,user_data=None,user_id='99403819bf9845ac85cf9ff73a492507',uuid=840e5d07-c2f2-40b3-b05a-23bd8acf56bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converting VIF {"id": "8f16a496-af41-465a-a478-f5c6f43381c1", "address": "fa:16:3e:c2:ac:f3", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f16a496-af", "ovs_interfaceid": "8f16a496-af41-465a-a478-f5c6f43381c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG os_vif [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f16a496-af, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4ed9120-e0ee-48bd-b668-1401d0b76bd4) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:44 user nova-compute[74932]: INFO os_vif [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:ac:f3,bridge_name='br-int',has_traffic_filtering=True,id=8f16a496-af41-465a-a478-f5c6f43381c1,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f16a496-af')
Nov 03 16:40:44 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Deleting instance files /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd_del
Nov 03 16:40:44 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Deletion of /opt/stack/data/nova/instances/840e5d07-c2f2-40b3-b05a-23bd8acf56bd_del complete
Nov 03 16:40:44 user nova-compute[74932]: INFO nova.compute.manager [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 16:40:44 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:40:44 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:40:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:40:45 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Took 0.46 seconds to deallocate network for instance.
Nov 03 16:40:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:45 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:40:45 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:40:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:45 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Deleted allocations for instance 840e5d07-c2f2-40b3-b05a-23bd8acf56bd
Nov 03 16:40:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-1fada1b2-a4f9-4eae-9322-e6dab461f82d tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.908s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] Acquiring lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] Lock "840e5d07-c2f2-40b3-b05a-23bd8acf56bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] No waiting events found dispatching network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:40:46 user nova-compute[74932]: WARNING nova.compute.manager [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received unexpected event network-vif-plugged-8f16a496-af41-465a-a478-f5c6f43381c1 for instance with vm_state deleted and task_state None.
Nov 03 16:40:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-2eba73fa-2de9-456b-a264-7f71abb228dc req-a95aa1f1-4ba9-4916-8788-3aea3bdf2c40 service nova] [instance: 840e5d07-c2f2-40b3-b05a-23bd8acf56bd] Received event network-vif-deleted-8f16a496-af41-465a-a478-f5c6f43381c1 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:40:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:40:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:40:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:40:51 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating instance_info_cache with network_info: [{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:40:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:40:51 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:40:51 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-changed-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:40:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Refreshing instance network info cache due to event network-changed-062ca92a-1357-4dc6-9899-fe4b4c710d6b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:40:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] Acquiring lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:40:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] Acquired lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:40:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Refreshing network info cache for port 062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:40:53 user nova-compute[74932]: DEBUG nova.network.neutron [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updated VIF entry in instance network info cache for port 062ca92a-1357-4dc6-9899-fe4b4c710d6b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:40:53 user nova-compute[74932]: DEBUG nova.network.neutron [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updating instance_info_cache with network_info: [{"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:40:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-33289507-4422-4897-99dd-5eb5fdca461d req-c736d185-8bbb-4bb9-913c-361d19c6269b service nova] Releasing lock "refresh_cache-1d3c17fc-aceb-4974-a312-6d8241fd45ce" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:40:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:40:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG nova.objects.instance [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:40:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:40:58 user nova-compute[74932]: INFO nova.compute.manager [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Attaching volume 4ca87ddc-35e9-48aa-8b15-d683b6bfe362 to /dev/vdb
Nov 03 16:40:59 user nova-compute[74932]: DEBUG os_brick.utils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[83483d85-76c4-442a-9c0e-01605ceb5746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b52501b-26b1-4482-908e-a41cd936d300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.067s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ac0ec-8f8d-4382-abca-98d36e92a6ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4150b054-6d34-4a2f-ac8b-925a12dbf05d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:40:59 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d016354-019a-4f49-93cb-33693e4743bf]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG os_brick.utils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updating existing volume attachment record: c21b3cda-7821-483e-a736-fd31b03f9753 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:40:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:00 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:04 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:41:04 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7462MB free_disk=24.75067138671875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance ad86cdd7-1253-4246-ac62-32c4898b30df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5aa105d4-e07c-48aa-8931-528c4c924e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:41:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:08 user nova-compute[74932]: INFO nova.compute.manager [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Detaching volume a96b913e-a89b-49e2-9cdd-9707f2c99d5e
Nov 03 16:41:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:08 user nova-compute[74932]: INFO nova.virt.block_device [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Attempting to driver detach volume a96b913e-a89b-49e2-9cdd-9707f2c99d5e from mountpoint /dev/vdb
Nov 03 16:41:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Attempting to detach device vdb from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:41:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:41:08 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:41:08 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:41:08 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:41:08 user nova-compute[74932]:   <serial>a96b913e-a89b-49e2-9cdd-9707f2c99d5e</serial>
Nov 03 16:41:08 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 16:41:08 user nova-compute[74932]: </disk>
Nov 03 16:41:08 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:41:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully detached device vdb from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 from the persistent domain config.
Nov 03 16:41:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:41:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:41:08 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:41:08 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:41:08 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:41:08 user nova-compute[74932]:   <serial>a96b913e-a89b-49e2-9cdd-9707f2c99d5e</serial>
Nov 03 16:41:08 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 16:41:08 user nova-compute[74932]: </disk>
Nov 03 16:41:08 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:41:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:41:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:20 user nova-compute[74932]: INFO nova.compute.manager [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Unrescuing
Nov 03 16:41:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:20 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:41:20 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:20 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:20 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'flavor' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-17b26057-c1a0-48b2-87ed-fa12a25941c1 req-d9a0b3a5-3d2c-4db0-9b7a-b2ec140d569f service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-17b26057-c1a0-48b2-87ed-fa12a25941c1 req-d9a0b3a5-3d2c-4db0-9b7a-b2ec140d569f service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-17b26057-c1a0-48b2-87ed-fa12a25941c1 req-d9a0b3a5-3d2c-4db0-9b7a-b2ec140d569f service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-17b26057-c1a0-48b2-87ed-fa12a25941c1 req-d9a0b3a5-3d2c-4db0-9b7a-b2ec140d569f service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-17b26057-c1a0-48b2-87ed-fa12a25941c1 req-d9a0b3a5-3d2c-4db0-9b7a-b2ec140d569f service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:21 user nova-compute[74932]: WARNING nova.compute.manager [req-17b26057-c1a0-48b2-87ed-fa12a25941c1 req-d9a0b3a5-3d2c-4db0-9b7a-b2ec140d569f service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:41:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance destroyed successfully.
Nov 03 16:41:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXMHuRea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:41:21 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:41:21 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:41:21 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c829045-d4a7-45b2-94ef-68032a61699c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:41:21 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b901639f-2cf8-41d7-a4b2-80a03952796f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362] added
Nov 03 16:41:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[367df90e-1d2d-426a-afe8-dc4d6661d5d0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[89984d25-4f22-44af-9982-a024ff7b1ffb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:41:21 user nova-compute[74932]: INFO nova.compute.claims [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Claim successful on node user
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXMHuRea {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXMHuRea" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9ac0f7-fa28-4c7d-9ca7-cf490b249dc3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iXMHuRea'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b2e0a-3f59-467c-88a9-efe033df12cf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c49e9fc-a2ff-4821-b847-78bec1937e11]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:21 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:41:21 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:21 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:41:21 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:21 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:41:21 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c21fb6b-17e7-4d48-8667-347893d4ec98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260]
Nov 03 16:41:22 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260] successful.
Nov 03 16:41:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[23128d41-6301-4382-ba9d-e73ea1b9d7b5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3906819-9a92-47b4-9372-8dc8612834aa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:22 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:41:22 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:22 user nova-compute[74932]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)
Nov 03 16:41:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:22 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:41:22 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:22 user nova-compute[74932]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)
Nov 03 16:41:22 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[18908f8c-31a5-4888-9a01-1ca14c26701a]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXMHuRea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:41:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.policy [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd1db8beca33482681f7d7b701d762f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84af8fad5724ccc9e09836bcebb1ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:41:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Creating image(s)
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.064s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "9fc443a77dcfdacc08bbb39b504ee21a46695482" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "9fc443a77dcfdacc08bbb39b504ee21a46695482" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.572s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '23763313635616537', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763313635616537', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-69c007dd-ebaa-49ce-97f8-3900be4c6adf req-5eab1d96-dd8b-44fb-b1e3-36b4fd8b7b83 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69c007dd-ebaa-49ce-97f8-3900be4c6adf req-5eab1d96-dd8b-44fb-b1e3-36b4fd8b7b83 service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69c007dd-ebaa-49ce-97f8-3900be4c6adf req-5eab1d96-dd8b-44fb-b1e3-36b4fd8b7b83 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-69c007dd-ebaa-49ce-97f8-3900be4c6adf req-5eab1d96-dd8b-44fb-b1e3-36b4fd8b7b83 service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.compute.manager [req-69c007dd-ebaa-49ce-97f8-3900be4c6adf req-5eab1d96-dd8b-44fb-b1e3-36b4fd8b7b83 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:23 user nova-compute[74932]: WARNING nova.compute.manager [req-69c007dd-ebaa-49ce-97f8-3900be4c6adf req-5eab1d96-dd8b-44fb-b1e3-36b4fd8b7b83 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Successfully created port: 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.objects.instance [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:41:23 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:41:23 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:41:23 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:41:23 user nova-compute[74932]:   <serial>4ca87ddc-35e9-48aa-8b15-d683b6bfe362</serial>
Nov 03 16:41:23 user nova-compute[74932]: </disk>
Nov 03 16:41:23 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.virt.images [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] 35e93787-0a72-4388-8e41-a72dba694e9e was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.part /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.part /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.converted" returned: 0 in 0.299s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "9fc443a77dcfdacc08bbb39b504ee21a46695482" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.223s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Successfully updated port: 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing instance network info cache due to event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "9fc443a77dcfdacc08bbb39b504ee21a46695482" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "9fc443a77dcfdacc08bbb39b504ee21a46695482" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] No VIF found with MAC fa:16:3e:79:38:70, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482,backing_fmt=raw /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482,backing_fmt=raw /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk 1073741824" returned: 0 in 0.060s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "9fc443a77dcfdacc08bbb39b504ee21a46695482" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance network_info: |[{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.neutron [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-fda009c1-b43b-41a2-a768-a00a109b6e85 tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.651s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Cannot resize image /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Ensure instance console log exists: /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Start _get_guest_xml network_info=[{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:41:18Z,direct_url=<?>,disk_format='qcow2',id=35e93787-0a72-4388-8e41-a72dba694e9e,min_disk=0,min_ram=0,name='tempest-scenario-img--637182242',owner='a84af8fad5724ccc9e09836bcebb1ada',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:41:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '35e93787-0a72-4388-8e41-a72dba694e9e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:41:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:41:24 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:41:18Z,direct_url=<?>,disk_format='qcow2',id=35e93787-0a72-4388-8e41-a72dba694e9e,min_disk=0,min_ram=0,name='tempest-scenario-img--637182242',owner='a84af8fad5724ccc9e09836bcebb1ada',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:41:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329843655',display_name='tempest-TestMinimumBasicScenario-server-1329843655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329843655',id=33,image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzIHQexU1m2W5QsFqd6Q7i8UiToJ5TQ321aeCEjlM8ySKJmAhlSMxg+P5IPxaD/sjXVZ5imyXrq7ejkhMBybtHu0n/rHm4RtCp6vX6nd8EGOCOBwj1JTjuQ6cQRJjOEtQ==',key_name='tempest-TestMinimumBasicScenario-928640101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-psdcoxqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:41:23Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=7b1de337-1b43-473b-b929-5e4e357ba9ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:41:24 user nova-compute[74932]: DEBUG nova.objects.instance [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:41:25 user nova-compute[74932]:   <uuid>7b1de337-1b43-473b-b929-5e4e357ba9ac</uuid>
Nov 03 16:41:25 user nova-compute[74932]:   <name>instance-00000021</name>
Nov 03 16:41:25 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:41:25 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:41:25 user nova-compute[74932]:   <metadata>
Nov 03 16:41:25 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:41:25 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:41:25 user nova-compute[74932]:       <nova:name>tempest-TestMinimumBasicScenario-server-1329843655</nova:name>
Nov 03 16:41:25 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:41:24</nova:creationTime>
Nov 03 16:41:25 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:41:25 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:41:25 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:41:25 user nova-compute[74932]:       <nova:owner>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:user uuid="fd1db8beca33482681f7d7b701d762f6">tempest-TestMinimumBasicScenario-62950615-project-member</nova:user>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:project uuid="a84af8fad5724ccc9e09836bcebb1ada">tempest-TestMinimumBasicScenario-62950615</nova:project>
Nov 03 16:41:25 user nova-compute[74932]:       </nova:owner>
Nov 03 16:41:25 user nova-compute[74932]:       <nova:root type="image" uuid="35e93787-0a72-4388-8e41-a72dba694e9e"/>
Nov 03 16:41:25 user nova-compute[74932]:       <nova:ports>
Nov 03 16:41:25 user nova-compute[74932]:         <nova:port uuid="5c6be14a-8f34-4ec5-8553-fa93ef13051d">
Nov 03 16:41:25 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 16:41:25 user nova-compute[74932]:         </nova:port>
Nov 03 16:41:25 user nova-compute[74932]:       </nova:ports>
Nov 03 16:41:25 user nova-compute[74932]:     </nova:instance>
Nov 03 16:41:25 user nova-compute[74932]:   </metadata>
Nov 03 16:41:25 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:41:25 user nova-compute[74932]:     <system>
Nov 03 16:41:25 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:41:25 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:41:25 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:41:25 user nova-compute[74932]:       <entry name="serial">7b1de337-1b43-473b-b929-5e4e357ba9ac</entry>
Nov 03 16:41:25 user nova-compute[74932]:       <entry name="uuid">7b1de337-1b43-473b-b929-5e4e357ba9ac</entry>
Nov 03 16:41:25 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:41:25 user nova-compute[74932]:     </system>
Nov 03 16:41:25 user nova-compute[74932]:   </sysinfo>
Nov 03 16:41:25 user nova-compute[74932]:   <os>
Nov 03 16:41:25 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:41:25 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:41:25 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:41:25 user nova-compute[74932]:   </os>
Nov 03 16:41:25 user nova-compute[74932]:   <features>
Nov 03 16:41:25 user nova-compute[74932]:     <acpi/>
Nov 03 16:41:25 user nova-compute[74932]:     <apic/>
Nov 03 16:41:25 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:41:25 user nova-compute[74932]:   </features>
Nov 03 16:41:25 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:41:25 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:41:25 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:41:25 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:41:25 user nova-compute[74932]:   </clock>
Nov 03 16:41:25 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:41:25 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:41:25 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:41:25 user nova-compute[74932]:   </cpu>
Nov 03 16:41:25 user nova-compute[74932]:   <devices>
Nov 03 16:41:25 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:41:25 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:41:25 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk"/>
Nov 03 16:41:25 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:41:25 user nova-compute[74932]:     </disk>
Nov 03 16:41:25 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:41:25 user nova-compute[74932]:       <mac address="fa:16:3e:b6:9b:05"/>
Nov 03 16:41:25 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:41:25 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:41:25 user nova-compute[74932]:       <target dev="tap5c6be14a-8f"/>
Nov 03 16:41:25 user nova-compute[74932]:     </interface>
Nov 03 16:41:25 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:41:25 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/console.log" append="off"/>
Nov 03 16:41:25 user nova-compute[74932]:     </serial>
Nov 03 16:41:25 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:41:25 user nova-compute[74932]:     <video>
Nov 03 16:41:25 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:41:25 user nova-compute[74932]:     </video>
Nov 03 16:41:25 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:41:25 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:41:25 user nova-compute[74932]:     </rng>
Nov 03 16:41:25 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:41:25 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:41:25 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:41:25 user nova-compute[74932]:     </memballoon>
Nov 03 16:41:25 user nova-compute[74932]:   </devices>
Nov 03 16:41:25 user nova-compute[74932]: </domain>
Nov 03 16:41:25 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329843655',display_name='tempest-TestMinimumBasicScenario-server-1329843655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329843655',id=33,image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzIHQexU1m2W5QsFqd6Q7i8UiToJ5TQ321aeCEjlM8ySKJmAhlSMxg+P5IPxaD/sjXVZ5imyXrq7ejkhMBybtHu0n/rHm4RtCp6vX6nd8EGOCOBwj1JTjuQ6cQRJjOEtQ==',key_name='tempest-TestMinimumBasicScenario-928640101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-psdcoxqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:41:23Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=7b1de337-1b43-473b-b929-5e4e357ba9ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG os_vif [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ecc091a-518d-51b9-b9c8-2c31fdfca41e', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c6be14a-8f, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c6be14a-8f, col_values=(('qos', UUID('06109221-1f9c-4343-b24c-512629e6e72d')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c6be14a-8f, col_values=(('external_ids', {'iface-id': '5c6be14a-8f34-4ec5-8553-fa93ef13051d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9b:05', 'vm-uuid': '7b1de337-1b43-473b-b929-5e4e357ba9ac'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:25 user nova-compute[74932]: INFO os_vif [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f')
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No VIF found with MAC fa:16:3e:b6:9b:05, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updated VIF entry in instance network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-521d8933-f883-4476-a822-0b2252964cc8 req-571acddb-95ee-47d7-8f19-1b886c702f67 service nova] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:25 user nova-compute[74932]: INFO nova.compute.manager [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Detaching volume 4ca87ddc-35e9-48aa-8b15-d683b6bfe362
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:25 user nova-compute[74932]: WARNING nova.compute.manager [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:25 user nova-compute[74932]: WARNING nova.compute.manager [req-c97a5536-6d42-4d39-9165-b11792947413 req-e295426b-7e8e-40de-b5ce-1b71500bab5c service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:25 user nova-compute[74932]: INFO nova.virt.block_device [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Attempting to driver detach volume 4ca87ddc-35e9-48aa-8b15-d683b6bfe362 from mountpoint /dev/vdb
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Attempting to detach device vdb from instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:41:25 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:41:25 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:41:25 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:41:25 user nova-compute[74932]:   <serial>4ca87ddc-35e9-48aa-8b15-d683b6bfe362</serial>
Nov 03 16:41:25 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:41:25 user nova-compute[74932]: </disk>
Nov 03 16:41:25 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:41:25 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully detached device vdb from instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce from the persistent domain config.
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:41:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:41:25 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:41:25 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:41:25 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:41:25 user nova-compute[74932]:   <serial>4ca87ddc-35e9-48aa-8b15-d683b6bfe362</serial>
Nov 03 16:41:25 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:41:25 user nova-compute[74932]: </disk>
Nov 03 16:41:25 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:41:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:41:26 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d1824365-1e4d-4769-b1c7-e728fe800a35 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:41:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:27 user nova-compute[74932]: WARNING nova.compute.manager [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state building and task_state spawning.
Nov 03 16:41:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:27 user nova-compute[74932]: WARNING nova.compute.manager [req-2d98518e-5461-4d95-9580-93c4b3796faa req-2d735890-f6d5-4a80-8770-89346959e16d service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state building and task_state spawning.
Nov 03 16:41:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:28 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 is timed out.
Nov 03 16:41:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully detached device vdb from instance 5aa105d4-e07c-48aa-8931-528c4c924e03 from the live domain config.
Nov 03 16:41:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVxPOtbC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:41:28 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9e2748-9a8e-40e0-9c4f-b39d872efc1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:41:28 user nova-compute[74932]: No targets found.
Nov 03 16:41:28 user nova-compute[74932]: iSNS:
Nov 03 16:41:28 user nova-compute[74932]: No targets found.
Nov 03 16:41:28 user nova-compute[74932]: STATIC:
Nov 03 16:41:28 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330
Nov 03 16:41:28 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:28 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:28 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362
Nov 03 16:41:28 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:28 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:28 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:41:28 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:28 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:28 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e
Nov 03 16:41:28 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:28 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:28 user nova-compute[74932]: FIRMWARE:
Nov 03 16:41:28 user nova-compute[74932]: No targets found.
Nov 03 16:41:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:41:28 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:41:28 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e22b625-a6c1-49ae-ab22-b788928f0285]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3049a96e-2ce6-4a2e-be95-f2ffa63ce0c7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:28 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:41:28 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:28 user nova-compute[74932]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)
Nov 03 16:41:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:28 user nova-compute[74932]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e (non-flash)
Nov 03 16:41:28 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:28 user nova-compute[74932]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)
Nov 03 16:41:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64329f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[932e3c73-68ff-444d-b5ef-d87bfeeef581]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb28eb5-91ce-4eec-8b6c-c41531406d2c]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2971f6-c3f2-4be2-bd98-1cd55366ae36]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a211f9-679a-4c65-9771-0b453d0c9dba]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd38320f-4ef6-4f66-8d64-298cea7dedf0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fda02c-27f3-4bfc-a9d1-c3881097bdec]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260]
Nov 03 16:41:28 user nova-compute[74932]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e, portal: 172.16.0.220,3260] successful.
Nov 03 16:41:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96b913e-a89b-49e2-9cdd-9707f2c99d5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df9badf-44d4-4eaf-9221-a79ee74311c0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== disconnect_volume: return (305ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:41:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:41:29 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance spawned successfully.
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:41:29 user nova-compute[74932]: INFO nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:41:29 user nova-compute[74932]: INFO nova.compute.manager [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Took 7.40 seconds to build instance.
Nov 03 16:41:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-8f8705e7-5de3-4b49-a2be-343102e1c6be tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.592s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'flavor' on Instance uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d11bc8f1-00eb-413f-9591-b2d15013d8c0 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing instance network info cache due to event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'flavor' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:41 user nova-compute[74932]: INFO nova.compute.manager [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Attaching volume 04a8ab47-5482-4fda-9ea1-074960d43ced to /dev/vdb
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updated VIF entry in instance network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG os_brick.utils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7cf4a13c-a8c2-4c00-84b1-643fb169bce8 req-dbc01ac7-5d7f-4285-b23b-1abe048170e0 service nova] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04f982-5dc7-461f-b8cf-60b01e2fcf5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d90e90-78ab-42ae-b78a-d93661ce70e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[684634fe-5711-4998-8fd8-a4df00026bc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb6bc2-f56b-4967-b30a-c6a695d465e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:41:41 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:41:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa266a6-0f09-4d87-a92e-79c3aef645ce]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG os_brick.utils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:41:41 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating existing volume attachment record: 0c77a9ec-5592-4bda-8d5f-0dfbd03bd0ff {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:41:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:46 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce is timed out.
Nov 03 16:41:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully detached device vdb from instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce from the live domain config.
Nov 03 16:41:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXMHuRea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:41:46 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b5336-5e73-44a7-bd90-a3097e4770e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:41:46 user nova-compute[74932]: No targets found.
Nov 03 16:41:46 user nova-compute[74932]: iSNS:
Nov 03 16:41:46 user nova-compute[74932]: No targets found.
Nov 03 16:41:46 user nova-compute[74932]: STATIC:
Nov 03 16:41:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330
Nov 03 16:41:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362
Nov 03 16:41:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:46 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:41:46 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:41:46 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:41:46 user nova-compute[74932]: FIRMWARE:
Nov 03 16:41:46 user nova-compute[74932]: No targets found.
Nov 03 16:41:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:41:46 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:41:46 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d37401-e20f-4d9c-b1c9-18360faa4235]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f54c9-e5bb-4634-8398-fd5beab81441]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:46 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:46 user nova-compute[74932]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)
Nov 03 16:41:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:41:46 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:41:46 user nova-compute[74932]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 (non-flash)
Nov 03 16:41:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8456f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[df996e2c-2ee5-4cc8-b8b2-20d36e9219fc]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4139a8-9b6c-4b8d-a7d5-c3073129b2c2]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f5716-3fb5-46dd-be55-4a077671b77d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb5f138-d319-4e92-90e4-f8a7703ef4b1]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88de138-8795-4557-82f4-5e9427de90f8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a068c9b3-aebb-4179-8e5f-2a94baa507a5]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260]
Nov 03 16:41:46 user nova-compute[74932]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362, portal: 172.16.0.220,3260] successful.
Nov 03 16:41:46 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca87ddc-35e9-48aa-8b15-d683b6bfe362 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5106efa4-c52d-4f88-bac2-43d6667ffea5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] <== disconnect_volume: return (315ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:41:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:41:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'flavor' on Instance uuid 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-5f928921-d6a8-45fb-801a-1392a171343d tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.153s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:48 user nova-compute[74932]: INFO nova.compute.manager [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Unrescuing
Nov 03 16:41:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'flavor' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-03425fe9-2097-4102-99ae-60770210ba4b req-9d3264da-098e-41f1-bbf7-da98d11de14f service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-03425fe9-2097-4102-99ae-60770210ba4b req-9d3264da-098e-41f1-bbf7-da98d11de14f service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-03425fe9-2097-4102-99ae-60770210ba4b req-9d3264da-098e-41f1-bbf7-da98d11de14f service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-03425fe9-2097-4102-99ae-60770210ba4b req-9d3264da-098e-41f1-bbf7-da98d11de14f service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-03425fe9-2097-4102-99ae-60770210ba4b req-9d3264da-098e-41f1-bbf7-da98d11de14f service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:49 user nova-compute[74932]: WARNING nova.compute.manager [req-03425fe9-2097-4102-99ae-60770210ba4b req-9d3264da-098e-41f1-bbf7-da98d11de14f service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing instance network info cache due to event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG nova.network.neutron [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:41:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:49 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance destroyed successfully.
Nov 03 16:41:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updated VIF entry in instance network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e9843ece-988e-47fe-8e25-a8a5165f5d09 req-38a1dd7c-500c-4cc8-94ef-1bcb1c68da20 service nova] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updating instance_info_cache with network_info: [{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-c5a19953-9a45-439f-b0bd-268cc12610b6 req-f77c3990-c39a-4ee4-9a02-e086d8c80871 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5a19953-9a45-439f-b0bd-268cc12610b6 req-f77c3990-c39a-4ee4-9a02-e086d8c80871 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5a19953-9a45-439f-b0bd-268cc12610b6 req-f77c3990-c39a-4ee4-9a02-e086d8c80871 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c5a19953-9a45-439f-b0bd-268cc12610b6 req-f77c3990-c39a-4ee4-9a02-e086d8c80871 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-c5a19953-9a45-439f-b0bd-268cc12610b6 req-f77c3990-c39a-4ee4-9a02-e086d8c80871 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:51 user nova-compute[74932]: WARNING nova.compute.manager [req-c5a19953-9a45-439f-b0bd-268cc12610b6 req-f77c3990-c39a-4ee4-9a02-e086d8c80871 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing instance network info cache due to event network-changed-2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG nova.network.neutron [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Refreshing network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updated VIF entry in instance network info cache for port 2002e939-5f21-48cf-8aae-7868f7c6992a. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:41:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d9561682-1308-4219-8e31-9a4553e73018 req-a619c400-a90e-4c7d-bb43-40dede69ae2a service nova] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:53 user nova-compute[74932]: WARNING nova.compute.manager [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:53 user nova-compute[74932]: DEBUG nova.compute.manager [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:53 user nova-compute[74932]: WARNING nova.compute.manager [req-a36531dd-9291-491d-b749-6208c757d71c req-0b264b46-8bc1-4084-8fc0-58dddd818359 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:41:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f581fc3d-367b-41fa-938b-e51961cebdc5 tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:41:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:41:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-changed-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Refreshing instance network info cache due to event network-changed-032a623c-ee7b-4830-8652-1c825c7f9bbb. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] Acquiring lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] Acquired lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.network.neutron [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Refreshing network info cache for port 032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:57 user nova-compute[74932]: INFO nova.compute.manager [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Terminating instance
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-9bdf0766-5826-4bb0-a51a-9b8f5f29fe7f req-c4ecfd09-748e-48a8-8075-ab808a3232e9 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-vif-unplugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9bdf0766-5826-4bb0-a51a-9b8f5f29fe7f req-c4ecfd09-748e-48a8-8075-ab808a3232e9 service nova] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9bdf0766-5826-4bb0-a51a-9b8f5f29fe7f req-c4ecfd09-748e-48a8-8075-ab808a3232e9 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9bdf0766-5826-4bb0-a51a-9b8f5f29fe7f req-c4ecfd09-748e-48a8-8075-ab808a3232e9 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-9bdf0766-5826-4bb0-a51a-9b8f5f29fe7f req-c4ecfd09-748e-48a8-8075-ab808a3232e9 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] No waiting events found dispatching network-vif-unplugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:41:57 user nova-compute[74932]: DEBUG nova.compute.manager [req-9bdf0766-5826-4bb0-a51a-9b8f5f29fe7f req-c4ecfd09-748e-48a8-8075-ab808a3232e9 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-vif-unplugged-032a623c-ee7b-4830-8652-1c825c7f9bbb for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Instance destroyed successfully.
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.objects.instance [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lazy-loading 'resources' on Instance uuid ad86cdd7-1253-4246-ac62-32c4898b30df {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-493201516',display_name='tempest-TestStampPattern-server-493201516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-493201516',id=23,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMj9AIFIKO0NgK0zkHn0Jy+l3mgfcxgiBUpQw/9Yol77VWUT8u3eYfCI0rb+RgkX7v+WG5SHkNUka8piM/z+1zFyCPRyze8JQydhtJPBVujfoF47Ahsa+Vb6gz5xkxMaw==',key_name='tempest-TestStampPattern-1337686481',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c887cbc267d40dd9e270a25f6baf66f',ramdisk_id='',reservation_id='r-tnhs7060',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1606523677',owner_user_name='tempest-TestStampPattern-1606523677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:37:21Z,user_data=None,user_id='99403819bf9845ac85cf9ff73a492507',uuid=ad86cdd7-1253-4246-ac62-32c4898b30df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converting VIF {"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG os_vif [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap032a623c-ee, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5414fff1-21dc-42fa-9095-d93fa9c4b549) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:41:58 user nova-compute[74932]: INFO os_vif [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=032a623c-ee7b-4830-8652-1c825c7f9bbb,network=Network(8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032a623c-ee')
Nov 03 16:41:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Deleting instance files /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df_del
Nov 03 16:41:58 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Deletion of /opt/stack/data/nova/instances/ad86cdd7-1253-4246-ac62-32c4898b30df_del complete
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updated VIF entry in instance network info cache for port 032a623c-ee7b-4830-8652-1c825c7f9bbb. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.network.neutron [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating instance_info_cache with network_info: [{"id": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "address": "fa:16:3e:af:a5:76", "network": {"id": "8c1e83ac-3f4b-41a2-b5af-de53f7cd6f91", "bridge": "br-int", "label": "tempest-TestStampPattern-1754203549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c887cbc267d40dd9e270a25f6baf66f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap032a623c-ee", "ovs_interfaceid": "032a623c-ee7b-4830-8652-1c825c7f9bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0839b2fe-3c5c-44d0-842e-b7587be15db0 req-df2eab5c-0ab2-40a7-964a-9753967a6d69 service nova] Releasing lock "refresh_cache-ad86cdd7-1253-4246-ac62-32c4898b30df" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:41:58 user nova-compute[74932]: INFO nova.compute.manager [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:58 user nova-compute[74932]: INFO nova.compute.manager [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Terminating instance
Nov 03 16:41:58 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:41:59 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Took 1.04 seconds to deallocate network for instance.
Nov 03 16:41:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Instance destroyed successfully.
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'resources' on Instance uuid 5aa105d4-e07c-48aa-8931-528c4c924e03 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215066673',display_name='tempest-ServerActionsTestOtherA-server-53930940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-215066673',id=26,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVvr0cOtKAT7q7hEiUPtDBtsG9isgtmhqmtyfJlhfgje5zhIt7ontVt7eFV354uWtYe4DTjFXkkopLougoy6YNRz/8ZrTy44IyY937kIpKjwA/qUZYUJ0HOSdd+yheqxw==',key_name='tempest-keypair-593339944',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:38:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-fehc8j4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=5aa105d4-e07c-48aa-8931-528c4c924e03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "ce1737f3-6745-49e5-89de-7cd37dac064b", "address": "fa:16:3e:48:58:95", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1737f3-67", "ovs_interfaceid": "ce1737f3-6745-49e5-89de-7cd37dac064b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG os_vif [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce1737f3-67, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab504a4b-c687-47dc-9040-5fa02ae9876e) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:41:59 user nova-compute[74932]: INFO os_vif [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:58:95,bridge_name='br-int',has_traffic_filtering=True,id=ce1737f3-6745-49e5-89de-7cd37dac064b,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1737f3-67')
Nov 03 16:41:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Deleting instance files /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03_del
Nov 03 16:41:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Deletion of /opt/stack/data/nova/instances/5aa105d4-e07c-48aa-8931-528c4c924e03_del complete
Nov 03 16:41:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:41:59 user nova-compute[74932]: INFO nova.compute.manager [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 03 16:41:59 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:41:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:41:59 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Deleted allocations for instance ad86cdd7-1253-4246-ac62-32c4898b30df
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-af268a73-066d-4426-9a4e-682147deb8b6 tempest-TestStampPattern-1606523677 tempest-TestStampPattern-1606523677-project-member] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Acquiring lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Lock "ad86cdd7-1253-4246-ac62-32c4898b30df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] No waiting events found dispatching network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:00 user nova-compute[74932]: WARNING nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received unexpected event network-vif-plugged-032a623c-ee7b-4830-8652-1c825c7f9bbb for instance with vm_state deleted and task_state None.
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-unplugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-unplugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-unplugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: ad86cdd7-1253-4246-ac62-32c4898b30df] Received event network-vif-deleted-032a623c-ee7b-4830-8652-1c825c7f9bbb {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Acquiring lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] No waiting events found dispatching network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:00 user nova-compute[74932]: WARNING nova.compute.manager [req-f06c1c11-1c90-4f8a-9425-81bc714e333f req-8be294cc-9ba9-4e25-b1ac-17bf7fe104a6 service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received unexpected event network-vif-plugged-ce1737f3-6745-49e5-89de-7cd37dac064b for instance with vm_state active and task_state deleting.
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:42:00 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Took 0.85 seconds to deallocate network for instance.
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.258s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:00 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:42:00 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Deleted allocations for instance 5aa105d4-e07c-48aa-8931-528c4c924e03
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c04e324d-5b4b-42c0-a4c1-7c1aee35c4fa tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "5aa105d4-e07c-48aa-8931-528c4c924e03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.381s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:01 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG nova.compute.manager [req-6eb51b9f-182e-44e1-ba31-21bc40b9a346 req-0ba7bdb3-64b7-4b0a-8919-a8c05c4f8efa service nova] [instance: 5aa105d4-e07c-48aa-8931-528c4c924e03] Received event network-vif-deleted-ce1737f3-6745-49e5-89de-7cd37dac064b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZjuChxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:42:03 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:42:03 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:42:03 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c236e0d-b762-4bd1-abd4-9d5eaf8a8f43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:42:03 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[567bec07-2a91-444e-8158-f23a6b078e5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced] added
Nov 03 16:42:03 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[510109bd-d743-41e0-8e0e-7e772ac614e4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f629a-c906-4bb7-bd73-08e1c4927132]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZjuChxL {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZjuChxL" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf9840-8dc9-42c6-af81-64844c82754f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZjuChxL'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92cf332-4172-4865-ac5e-fc488bcd8858]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1716ce36-13e1-48ca-95a1-2441250a23c1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[97438488-c597-4e67-8a14-d86d86a88a0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260]
Nov 03 16:42:03 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260] successful.
Nov 03 16:42:03 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc7894-34dd-44af-9a29-6a4032042812]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c3970c-d0a6-4193-bc5d-62c1a088921c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:42:03 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:42:03 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:42:03 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f324f6-1c83-4e85-971a-51122433ed9a]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZjuChxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.632s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] <== connect_volume: return (1635ms) {'type': 'block', 'scsi_wwn': '26264613633356538', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264613633356538', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:42:05 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:42:05 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7785MB free_disk=24.788856506347656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.objects.instance [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'flavor' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:42:05 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:42:05 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:42:05 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:42:05 user nova-compute[74932]:   <serial>04a8ab47-5482-4fda-9ea1-074960d43ced</serial>
Nov 03 16:42:05 user nova-compute[74932]: </disk>
Nov 03 16:42:05 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 7b1de337-1b43-473b-b929-5e4e357ba9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:c4:0a:af, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:42:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cd854d2a-8f0e-4c22-b304-9a089ec98510 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:06 user nova-compute[74932]: INFO nova.compute.manager [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Rescuing
Nov 03 16:42:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:42:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:42:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-e80b3501-81b9-4c6f-b046-e21b69012a41 req-295b3eac-1979-48a3-a469-b27a9d4f017d service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e80b3501-81b9-4c6f-b046-e21b69012a41 req-295b3eac-1979-48a3-a469-b27a9d4f017d service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e80b3501-81b9-4c6f-b046-e21b69012a41 req-295b3eac-1979-48a3-a469-b27a9d4f017d service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e80b3501-81b9-4c6f-b046-e21b69012a41 req-295b3eac-1979-48a3-a469-b27a9d4f017d service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-e80b3501-81b9-4c6f-b046-e21b69012a41 req-295b3eac-1979-48a3-a469-b27a9d4f017d service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:07 user nova-compute[74932]: WARNING nova.compute.manager [req-e80b3501-81b9-4c6f-b046-e21b69012a41 req-295b3eac-1979-48a3-a469-b27a9d4f017d service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state active and task_state rescuing.
Nov 03 16:42:07 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance destroyed successfully.
Nov 03 16:42:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Attempting rescue
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74932) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:42:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Creating image(s)
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'trusted_certs' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue" returned: 0 in 0.049s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'migration_context' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.base [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<77b76574-4898-49f8-aaee-cff8f7e11b6e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Start _get_guest_xml network_info=[{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:c4:0a:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'resources' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.base [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<77b76574-4898-49f8-aaee-cff8f7e11b6e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'numa_topology' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.base [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<77b76574-4898-49f8-aaee-cff8f7e11b6e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:42:08 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:42:08 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.base [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<77b76574-4898-49f8-aaee-cff8f7e11b6e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-172897330',display_name='tempest-ServerRescueNegativeTestJSON-server-172897330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-172897330',id=32,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwyl71SkI69ufpiaDKKLYxWe0GV/IiYZYNRQC1KWGqgNr1y0Ycm5ZB3Z4cgBiUc128vQsYz17MojxO3lADHJNNYkd6mvQ5eRIIaDYD08kkSfOxaUH6iCopGtZrxkBf0XQ==',key_name='tempest-keypair-425901354',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-33le1rv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=77b76574-4898-49f8-aaee-cff8f7e11b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:c4:0a:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "vif_mac": "fa:16:3e:c4:0a:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'pci_devices' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.objects.base [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Object Instance<77b76574-4898-49f8-aaee-cff8f7e11b6e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:42:08 user nova-compute[74932]:   <uuid>77b76574-4898-49f8-aaee-cff8f7e11b6e</uuid>
Nov 03 16:42:08 user nova-compute[74932]:   <name>instance-00000020</name>
Nov 03 16:42:08 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:42:08 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:42:08 user nova-compute[74932]:   <metadata>
Nov 03 16:42:08 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:42:08 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:42:08 user nova-compute[74932]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-172897330</nova:name>
Nov 03 16:42:08 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:42:08</nova:creationTime>
Nov 03 16:42:08 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:42:08 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:42:08 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:42:08 user nova-compute[74932]:       <nova:owner>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:user uuid="462c0b16a5f744e49b3ee3ef8ee39e00">tempest-ServerRescueNegativeTestJSON-1518505179-project-member</nova:user>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:project uuid="dd1f1557f72d4ca1ac1d34772c23a953">tempest-ServerRescueNegativeTestJSON-1518505179</nova:project>
Nov 03 16:42:08 user nova-compute[74932]:       </nova:owner>
Nov 03 16:42:08 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:42:08 user nova-compute[74932]:       <nova:ports>
Nov 03 16:42:08 user nova-compute[74932]:         <nova:port uuid="3e54265e-4ed1-4af7-85d6-033ddbae3b7b">
Nov 03 16:42:08 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 16:42:08 user nova-compute[74932]:         </nova:port>
Nov 03 16:42:08 user nova-compute[74932]:       </nova:ports>
Nov 03 16:42:08 user nova-compute[74932]:     </nova:instance>
Nov 03 16:42:08 user nova-compute[74932]:   </metadata>
Nov 03 16:42:08 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:42:08 user nova-compute[74932]:     <system>
Nov 03 16:42:08 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:42:08 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:42:08 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:42:08 user nova-compute[74932]:       <entry name="serial">77b76574-4898-49f8-aaee-cff8f7e11b6e</entry>
Nov 03 16:42:08 user nova-compute[74932]:       <entry name="uuid">77b76574-4898-49f8-aaee-cff8f7e11b6e</entry>
Nov 03 16:42:08 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:42:08 user nova-compute[74932]:     </system>
Nov 03 16:42:08 user nova-compute[74932]:   </sysinfo>
Nov 03 16:42:08 user nova-compute[74932]:   <os>
Nov 03 16:42:08 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:42:08 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:42:08 user nova-compute[74932]:   </os>
Nov 03 16:42:08 user nova-compute[74932]:   <features>
Nov 03 16:42:08 user nova-compute[74932]:     <acpi/>
Nov 03 16:42:08 user nova-compute[74932]:     <apic/>
Nov 03 16:42:08 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:42:08 user nova-compute[74932]:   </features>
Nov 03 16:42:08 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:42:08 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:42:08 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:42:08 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:42:08 user nova-compute[74932]:   </clock>
Nov 03 16:42:08 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:42:08 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:42:08 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:42:08 user nova-compute[74932]:   </cpu>
Nov 03 16:42:08 user nova-compute[74932]:   <devices>
Nov 03 16:42:08 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:42:08 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:42:08 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue"/>
Nov 03 16:42:08 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:42:08 user nova-compute[74932]:     </disk>
Nov 03 16:42:08 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:42:08 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:42:08 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk"/>
Nov 03 16:42:08 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:42:08 user nova-compute[74932]:     </disk>
Nov 03 16:42:08 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:42:08 user nova-compute[74932]:       <mac address="fa:16:3e:c4:0a:af"/>
Nov 03 16:42:08 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:42:08 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:42:08 user nova-compute[74932]:       <target dev="tap3e54265e-4e"/>
Nov 03 16:42:08 user nova-compute[74932]:     </interface>
Nov 03 16:42:08 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:42:08 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/console.log" append="off"/>
Nov 03 16:42:08 user nova-compute[74932]:     </serial>
Nov 03 16:42:08 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:42:08 user nova-compute[74932]:     <video>
Nov 03 16:42:08 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:42:08 user nova-compute[74932]:     </video>
Nov 03 16:42:08 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:42:08 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:42:08 user nova-compute[74932]:     </rng>
Nov 03 16:42:08 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:42:08 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:42:08 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:42:08 user nova-compute[74932]:     </memballoon>
Nov 03 16:42:08 user nova-compute[74932]:   </devices>
Nov 03 16:42:08 user nova-compute[74932]: </domain>
Nov 03 16:42:08 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:42:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance destroyed successfully.
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:42:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] No VIF found with MAC fa:16:3e:c4:0a:af, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2176402-a8d9-4903-b54f-6bd58e279123 req-00326fd2-b46f-4589-a386-e516e3d9904c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2176402-a8d9-4903-b54f-6bd58e279123 req-00326fd2-b46f-4589-a386-e516e3d9904c service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2176402-a8d9-4903-b54f-6bd58e279123 req-00326fd2-b46f-4589-a386-e516e3d9904c service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2176402-a8d9-4903-b54f-6bd58e279123 req-00326fd2-b46f-4589-a386-e516e3d9904c service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2176402-a8d9-4903-b54f-6bd58e279123 req-00326fd2-b46f-4589-a386-e516e3d9904c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:09 user nova-compute[74932]: WARNING nova.compute.manager [req-f2176402-a8d9-4903-b54f-6bd58e279123 req-00326fd2-b46f-4589-a386-e516e3d9904c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state active and task_state rescuing.
Nov 03 16:42:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:11 user nova-compute[74932]: WARNING nova.compute.manager [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state active and task_state rescuing.
Nov 03 16:42:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:11 user nova-compute[74932]: WARNING nova.compute.manager [req-06de1f5d-f9d7-4adf-bd3a-3db7a7cd56e2 req-bdbf1724-4aa6-46c3-8af3-38087891dc2c service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state active and task_state rescuing.
Nov 03 16:42:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-27909fbb-e13a-48f2-83ef-87e7bbc0a1dd tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:42:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:15 user nova-compute[74932]: INFO nova.compute.manager [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Terminating instance
Nov 03 16:42:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-6b98b64f-7649-443d-ae43-5bd48196297e req-f6bf2e5b-95e2-49bf-b33d-8ea882743cc7 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-vif-unplugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6b98b64f-7649-443d-ae43-5bd48196297e req-f6bf2e5b-95e2-49bf-b33d-8ea882743cc7 service nova] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6b98b64f-7649-443d-ae43-5bd48196297e req-f6bf2e5b-95e2-49bf-b33d-8ea882743cc7 service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-6b98b64f-7649-443d-ae43-5bd48196297e req-f6bf2e5b-95e2-49bf-b33d-8ea882743cc7 service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-6b98b64f-7649-443d-ae43-5bd48196297e req-f6bf2e5b-95e2-49bf-b33d-8ea882743cc7 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] No waiting events found dispatching network-vif-unplugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-6b98b64f-7649-443d-ae43-5bd48196297e req-f6bf2e5b-95e2-49bf-b33d-8ea882743cc7 service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-vif-unplugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:42:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Instance destroyed successfully.
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lazy-loading 'resources' on Instance uuid 1d3c17fc-aceb-4974-a312-6d8241fd45ce {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-131860839',display_name='tempest-AttachVolumeNegativeTest-server-131860839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-131860839',id=31,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXtPTi48w6JLACIuPaWDs/KxmU8xyEMyHRwLIXCz5svrE8D66g9v7n1nLQNFxfEyIkW4e30wb2kWf539pmum3o9NQjQt1K593ijCdAfKBVHHMQrAsbu+HKFoUDk/5FUUw==',key_name='tempest-keypair-1796001998',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:39:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3be38a61a4094c9695a4111abe168c74',ramdisk_id='',reservation_id='r-gsq20oqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-855411700',owner_user_name='tempest-AttachVolumeNegativeTest-855411700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72b635150c614e459357225b83825e63',uuid=1d3c17fc-aceb-4974-a312-6d8241fd45ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converting VIF {"id": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "address": "fa:16:3e:79:38:70", "network": {"id": "bd163edf-cced-4823-9a08-fc950d1b2293", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-315730614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be38a61a4094c9695a4111abe168c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap062ca92a-13", "ovs_interfaceid": "062ca92a-1357-4dc6-9899-fe4b4c710d6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG os_vif [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap062ca92a-13, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ff04ada-0246-4cac-bceb-4dff97f47b8a) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:16 user nova-compute[74932]: INFO os_vif [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:38:70,bridge_name='br-int',has_traffic_filtering=True,id=062ca92a-1357-4dc6-9899-fe4b4c710d6b,network=Network(bd163edf-cced-4823-9a08-fc950d1b2293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap062ca92a-13')
Nov 03 16:42:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Deleting instance files /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce_del
Nov 03 16:42:16 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Deletion of /opt/stack/data/nova/instances/1d3c17fc-aceb-4974-a312-6d8241fd45ce_del complete
Nov 03 16:42:16 user nova-compute[74932]: INFO nova.compute.manager [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 16:42:16 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:42:16 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:42:17 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:42:17 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Took 1.16 seconds to deallocate network for instance.
Nov 03 16:42:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] Acquiring lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] No waiting events found dispatching network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:42:18 user nova-compute[74932]: WARNING nova.compute.manager [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received unexpected event network-vif-plugged-062ca92a-1357-4dc6-9899-fe4b4c710d6b for instance with vm_state deleted and task_state None.
Nov 03 16:42:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-da408726-7721-4266-8c1a-54b00198ea74 req-becadbc3-cf23-4f00-8644-16650c84b3bd service nova] [instance: 1d3c17fc-aceb-4974-a312-6d8241fd45ce] Received event network-vif-deleted-062ca92a-1357-4dc6-9899-fe4b4c710d6b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:42:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:18 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Deleted allocations for instance 1d3c17fc-aceb-4974-a312-6d8241fd45ce
Nov 03 16:42:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2206370d-b15e-43b4-ae57-9daa314319ea tempest-AttachVolumeNegativeTest-855411700 tempest-AttachVolumeNegativeTest-855411700-project-member] Lock "1d3c17fc-aceb-4974-a312-6d8241fd45ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:42:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:42:21 user nova-compute[74932]: INFO nova.compute.manager [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Detaching volume 790c2a93-130a-4ca6-83ca-72adb933a330
Nov 03 16:42:21 user nova-compute[74932]: INFO nova.virt.block_device [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Attempting to driver detach volume 790c2a93-130a-4ca6-83ca-72adb933a330 from mountpoint /dev/vdb
Nov 03 16:42:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Attempting to detach device vdb from instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:42:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:42:21 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:42:21 user nova-compute[74932]:   <source dev="/dev/sdh"/>
Nov 03 16:42:21 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:42:21 user nova-compute[74932]:   <serial>790c2a93-130a-4ca6-83ca-72adb933a330</serial>
Nov 03 16:42:21 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:42:21 user nova-compute[74932]: </disk>
Nov 03 16:42:21 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:42:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Successfully detached device vdb from instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 from the persistent domain config.
Nov 03 16:42:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:42:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:42:21 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:42:21 user nova-compute[74932]:   <source dev="/dev/sdh"/>
Nov 03 16:42:21 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:42:21 user nova-compute[74932]:   <serial>790c2a93-130a-4ca6-83ca-72adb933a330</serial>
Nov 03 16:42:21 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:42:21 user nova-compute[74932]: </disk>
Nov 03 16:42:21 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:42:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:42:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 is timed out.
Nov 03 16:42:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Successfully detached device vdb from instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 from the live domain config.
Nov 03 16:42:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsDKMySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:42:41 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:42:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b751942-d592-4b4a-93d6-f733de8a65fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:42:41 user nova-compute[74932]: No targets found.
Nov 03 16:42:41 user nova-compute[74932]: iSNS:
Nov 03 16:42:41 user nova-compute[74932]: No targets found.
Nov 03 16:42:41 user nova-compute[74932]: STATIC:
Nov 03 16:42:41 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330
Nov 03 16:42:41 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:42:41 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:42:41 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:42:41 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:42:41 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:42:41 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced
Nov 03 16:42:41 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:42:41 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:42:41 user nova-compute[74932]: FIRMWARE:
Nov 03 16:42:41 user nova-compute[74932]: No targets found.
Nov 03 16:42:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:42:41 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:42:41 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d9c047-992e-49ab-812a-f44e404bc4bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c5bd29-fad0-41f2-b68b-3579d0c09af7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:42:42 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:42:42 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:42:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:42:42 user nova-compute[74932]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 (non-flash)
Nov 03 16:42:42 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:42:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64202b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330'): ({'sdh'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Removing single pathed devices sdh {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d28309-6f78-4a92-8d4b-c3821e1c9e16]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac2ede-a290-4d52-b888-e753d7169429]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Flushing IO for device /dev/sdh {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b0b281-f792-495d-813e-66af045babb3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a82b0-dc7a-41c9-8b95-a447c476fc56]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] SCSI volumes sdh have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[25953714-bff7-431d-85d9-0f7f9f81bef0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b149e9-ca04-4d62-b58f-63cc5dd55502]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260]
Nov 03 16:42:42 user nova-compute[74932]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330, portal: 172.16.0.220,3260] successful.
Nov 03 16:42:42 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:790c2a93-130a-4ca6-83ca-72adb933a330 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab353a6-75db-4c13-877d-f05fac2366f7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] <== disconnect_volume: return (316ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:42:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:42:43 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'flavor' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:42:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b9d9724-3a60-4d82-a894-8f055cca04ca tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:42:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:42:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:42:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:42:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:42:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [{"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:42:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:42:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:42:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:42:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:42:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:42:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:06 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:43:06 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7933MB free_disk=24.812576293945312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 7b1de337-1b43-473b-b929-5e4e357ba9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:43:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:12 user nova-compute[74932]: INFO nova.compute.manager [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Terminating instance
Nov 03 16:43:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-2c93e817-fe71-4794-a543-99284a75698d req-e1cd0fed-6452-44ab-8869-ffeab7328747 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2c93e817-fe71-4794-a543-99284a75698d req-e1cd0fed-6452-44ab-8869-ffeab7328747 service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2c93e817-fe71-4794-a543-99284a75698d req-e1cd0fed-6452-44ab-8869-ffeab7328747 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2c93e817-fe71-4794-a543-99284a75698d req-e1cd0fed-6452-44ab-8869-ffeab7328747 service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-2c93e817-fe71-4794-a543-99284a75698d req-e1cd0fed-6452-44ab-8869-ffeab7328747 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-2c93e817-fe71-4794-a543-99284a75698d req-e1cd0fed-6452-44ab-8869-ffeab7328747 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-unplugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:12 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:43:12 user nova-compute[74932]: INFO nova.compute.claims [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Claim successful on node user
Nov 03 16:43:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Instance destroyed successfully.
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.objects.instance [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lazy-loading 'resources' on Instance uuid f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1558430644',display_name='tempest-ServerStableDeviceRescueTest-server-1558430644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1558430644',id=27,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOfnjxg1k3RnokJ4NfBnrK/mCaj28IuLgVS3j/qIcWiUnTJpvcQ+uVs1nHFqCd0jvtrSIQq6p/ff5t/X/f1lnz1UmiXu8t29wfw9LnfbTcubbeJTpTDglgAw9x/hp9/wg==',key_name='tempest-keypair-22406688',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='708c7a9d408f4b6e9300246c0bd84f73',ramdisk_id='',reservation_id='r-30ezqyyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-40984610',owner_user_name='tempest-ServerStableDeviceRescueTest-40984610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72961e6dbb884091a9b3fa92da558ef4',uuid=f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converting VIF {"id": "2002e939-5f21-48cf-8aae-7868f7c6992a", "address": "fa:16:3e:a1:c5:2e", "network": {"id": "4a3d8b26-c955-42f7-9b09-bed1d029d3e6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1006864100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "708c7a9d408f4b6e9300246c0bd84f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2002e939-5f", "ovs_interfaceid": "2002e939-5f21-48cf-8aae-7868f7c6992a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG os_vif [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2002e939-5f, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f29aa821-ad69-4d95-b714-56315f3b0a9a) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:13 user nova-compute[74932]: INFO os_vif [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:c5:2e,bridge_name='br-int',has_traffic_filtering=True,id=2002e939-5f21-48cf-8aae-7868f7c6992a,network=Network(4a3d8b26-c955-42f7-9b09-bed1d029d3e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2002e939-5f')
Nov 03 16:43:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Deleting instance files /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16_del
Nov 03 16:43:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Deletion of /opt/stack/data/nova/instances/f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16_del complete
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:43:13 user nova-compute[74932]: INFO nova.compute.manager [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:43:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.policy [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2fbcaa1d5bb4249b127dcdc0875517a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f123f628d784aaaadba9dea7eb71ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:43:13 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Creating image(s)
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "/opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk 1073741824" returned: 0 in 0.049s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Cannot resize image /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Ensure instance console log exists: /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Successfully created port: 7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:43:14 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Took 1.35 seconds to deallocate network for instance.
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-587337b2-72ca-4cad-bc79-d76901ae67ac req-59f0268c-cbb4-4b85-b99b-d5edf8db6a18 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-deleted-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:14 user nova-compute[74932]: INFO nova.compute.manager [req-587337b2-72ca-4cad-bc79-d76901ae67ac req-59f0268c-cbb4-4b85-b99b-d5edf8db6a18 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Neutron deleted interface 2002e939-5f21-48cf-8aae-7868f7c6992a; detaching it from the instance and deleting it from the info cache
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-587337b2-72ca-4cad-bc79-d76901ae67ac req-59f0268c-cbb4-4b85-b99b-d5edf8db6a18 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-587337b2-72ca-4cad-bc79-d76901ae67ac req-59f0268c-cbb4-4b85-b99b-d5edf8db6a18 service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Detach interface failed, port_id=2002e939-5f21-48cf-8aae-7868f7c6992a, reason: Instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-7a855a65-c635-4b2d-97a7-0d7d979cca1c req-0c37c51d-e52a-4d26-8f7d-7cc337b315ee service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7a855a65-c635-4b2d-97a7-0d7d979cca1c req-0c37c51d-e52a-4d26-8f7d-7cc337b315ee service nova] Acquiring lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7a855a65-c635-4b2d-97a7-0d7d979cca1c req-0c37c51d-e52a-4d26-8f7d-7cc337b315ee service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7a855a65-c635-4b2d-97a7-0d7d979cca1c req-0c37c51d-e52a-4d26-8f7d-7cc337b315ee service nova] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-7a855a65-c635-4b2d-97a7-0d7d979cca1c req-0c37c51d-e52a-4d26-8f7d-7cc337b315ee service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] No waiting events found dispatching network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:43:14 user nova-compute[74932]: WARNING nova.compute.manager [req-7a855a65-c635-4b2d-97a7-0d7d979cca1c req-0c37c51d-e52a-4d26-8f7d-7cc337b315ee service nova] [instance: f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16] Received unexpected event network-vif-plugged-2002e939-5f21-48cf-8aae-7868f7c6992a for instance with vm_state deleted and task_state None.
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:43:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:14 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Deleted allocations for instance f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Successfully updated port: 7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-868cd0e0-d5be-4e82-ab7f-7626c2c05afa tempest-ServerStableDeviceRescueTest-40984610 tempest-ServerStableDeviceRescueTest-40984610-project-member] Lock "f41ccd3e-29e4-48b9-8bd8-a2d3904d0f16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Updating instance_info_cache with network_info: [{"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Instance network_info: |[{"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Start _get_guest_xml network_info=[{"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:43:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:43:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1692367219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1692367219',id=34,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-n43sdmrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:43:13Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=995b57a0-17c8-4dc5-bc97-84c0a386bad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'pci_devices' on Instance uuid 995b57a0-17c8-4dc5-bc97-84c0a386bad8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:43:15 user nova-compute[74932]:   <uuid>995b57a0-17c8-4dc5-bc97-84c0a386bad8</uuid>
Nov 03 16:43:15 user nova-compute[74932]:   <name>instance-00000022</name>
Nov 03 16:43:15 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:43:15 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:43:15 user nova-compute[74932]:   <metadata>
Nov 03 16:43:15 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:43:15 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:43:15 user nova-compute[74932]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1692367219</nova:name>
Nov 03 16:43:15 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:43:15</nova:creationTime>
Nov 03 16:43:15 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:43:15 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:43:15 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:43:15 user nova-compute[74932]:       <nova:owner>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:user uuid="f2fbcaa1d5bb4249b127dcdc0875517a">tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member</nova:user>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:project uuid="5f123f628d784aaaadba9dea7eb71ce2">tempest-ServerBootFromVolumeStableRescueTest-2083155834</nova:project>
Nov 03 16:43:15 user nova-compute[74932]:       </nova:owner>
Nov 03 16:43:15 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:43:15 user nova-compute[74932]:       <nova:ports>
Nov 03 16:43:15 user nova-compute[74932]:         <nova:port uuid="7a3f4ec9-3f53-4611-9234-030908e10cec">
Nov 03 16:43:15 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 16:43:15 user nova-compute[74932]:         </nova:port>
Nov 03 16:43:15 user nova-compute[74932]:       </nova:ports>
Nov 03 16:43:15 user nova-compute[74932]:     </nova:instance>
Nov 03 16:43:15 user nova-compute[74932]:   </metadata>
Nov 03 16:43:15 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:43:15 user nova-compute[74932]:     <system>
Nov 03 16:43:15 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:43:15 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:43:15 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:43:15 user nova-compute[74932]:       <entry name="serial">995b57a0-17c8-4dc5-bc97-84c0a386bad8</entry>
Nov 03 16:43:15 user nova-compute[74932]:       <entry name="uuid">995b57a0-17c8-4dc5-bc97-84c0a386bad8</entry>
Nov 03 16:43:15 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:43:15 user nova-compute[74932]:     </system>
Nov 03 16:43:15 user nova-compute[74932]:   </sysinfo>
Nov 03 16:43:15 user nova-compute[74932]:   <os>
Nov 03 16:43:15 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:43:15 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:43:15 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:43:15 user nova-compute[74932]:   </os>
Nov 03 16:43:15 user nova-compute[74932]:   <features>
Nov 03 16:43:15 user nova-compute[74932]:     <acpi/>
Nov 03 16:43:15 user nova-compute[74932]:     <apic/>
Nov 03 16:43:15 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:43:15 user nova-compute[74932]:   </features>
Nov 03 16:43:15 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:43:15 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:43:15 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:43:15 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:43:15 user nova-compute[74932]:   </clock>
Nov 03 16:43:15 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:43:15 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:43:15 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:43:15 user nova-compute[74932]:   </cpu>
Nov 03 16:43:15 user nova-compute[74932]:   <devices>
Nov 03 16:43:15 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:43:15 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:43:15 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk"/>
Nov 03 16:43:15 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:43:15 user nova-compute[74932]:     </disk>
Nov 03 16:43:15 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:43:15 user nova-compute[74932]:       <mac address="fa:16:3e:a3:b0:ef"/>
Nov 03 16:43:15 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:43:15 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:43:15 user nova-compute[74932]:       <target dev="tap7a3f4ec9-3f"/>
Nov 03 16:43:15 user nova-compute[74932]:     </interface>
Nov 03 16:43:15 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:43:15 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/console.log" append="off"/>
Nov 03 16:43:15 user nova-compute[74932]:     </serial>
Nov 03 16:43:15 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:43:15 user nova-compute[74932]:     <video>
Nov 03 16:43:15 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:43:15 user nova-compute[74932]:     </video>
Nov 03 16:43:15 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:43:15 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:43:15 user nova-compute[74932]:     </rng>
Nov 03 16:43:15 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:43:15 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:43:15 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:43:15 user nova-compute[74932]:     </memballoon>
Nov 03 16:43:15 user nova-compute[74932]:   </devices>
Nov 03 16:43:15 user nova-compute[74932]: </domain>
Nov 03 16:43:15 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1692367219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1692367219',id=34,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-n43sdmrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:43:13Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=995b57a0-17c8-4dc5-bc97-84c0a386bad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG os_vif [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b74b85cc-41fc-51e6-9ef8-37265d57479a', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a3f4ec9-3f, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a3f4ec9-3f, col_values=(('qos', UUID('136ad874-8c3a-4513-83fb-ff197cdddc88')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a3f4ec9-3f, col_values=(('external_ids', {'iface-id': '7a3f4ec9-3f53-4611-9234-030908e10cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b0:ef', 'vm-uuid': '995b57a0-17c8-4dc5-bc97-84c0a386bad8'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:15 user nova-compute[74932]: INFO os_vif [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f')
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:43:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No VIF found with MAC fa:16:3e:a3:b0:ef, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-changed-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG nova.compute.manager [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Refreshing instance network info cache due to event network-changed-7a3f4ec9-3f53-4611-9234-030908e10cec. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] Acquiring lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] Acquired lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG nova.network.neutron [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Refreshing network info cache for port 7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:17 user nova-compute[74932]: DEBUG nova.network.neutron [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Updated VIF entry in instance network info cache for port 7a3f4ec9-3f53-4611-9234-030908e10cec. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:43:17 user nova-compute[74932]: DEBUG nova.network.neutron [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Updating instance_info_cache with network_info: [{"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:43:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-59d87d01-8eb5-4e0f-9291-95b51889c9de req-2c76eb10-d84c-4a75-9d0d-509c1a36413d service nova] Releasing lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'flavor' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:18 user nova-compute[74932]: INFO nova.compute.manager [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Attaching volume e844b6f6-757a-4036-ae09-8808f0cf1a9d to /dev/vdb
Nov 03 16:43:18 user nova-compute[74932]: DEBUG os_brick.utils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0612ce8-9ced-4ba8-a039-43709488523c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e500fd16-d850-4542-934c-fb34f8c2f4e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31c5615-31f3-4cd8-94a7-0c70e7cdc516]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a552b47e-4874-4474-86cd-8eb6ff678755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:43:18 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[27384c25-e3b0-48a8-8600-6fdfa9050893]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG os_brick.utils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating existing volume attachment record: fb8a7e12-1daa-4a49-96db-5e456940a225 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] No waiting events found dispatching network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:43:18 user nova-compute[74932]: WARNING nova.compute.manager [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received unexpected event network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec for instance with vm_state building and task_state spawning.
Nov 03 16:43:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] No waiting events found dispatching network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:43:18 user nova-compute[74932]: WARNING nova.compute.manager [req-cf5b34e5-fde9-411e-afb0-6be443bab867 req-c0e0036a-27b7-4133-9c22-4f07b508ec37 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received unexpected event network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec for instance with vm_state building and task_state spawning.
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:43:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Instance spawned successfully.
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:43:19 user nova-compute[74932]: INFO nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 03 16:43:19 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:43:19 user nova-compute[74932]: INFO nova.compute.manager [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Took 6.63 seconds to build instance.
Nov 03 16:43:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a42e71b6-53be-4d68-bc68-77d4393869c8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.751s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:43:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:43:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:43:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:43:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:43:40 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:43:40 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:43:40 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edaed23-109e-4ae6-8f3e-2454398dae7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:43:40 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89be96e-98a5-4862-96f0-1b63fc66d757]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d] added
Nov 03 16:43:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba7e61-cf14-4c40-8b0f-07533e991c0e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da2a3c-7d74-408e-9ddc-55153f49bda1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqTpWgEC {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqTpWgEC" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049d383-4df3-4a89-94f1-a0b04e47360c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XqTpWgEC'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d22b02-8fd5-4c72-bc2f-9fc29ef99d2b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6f57a2-127b-40b8-a662-b91b910a1e30]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:43:40 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:43:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:43:40 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:43:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c876eef6-f625-4c9c-b64a-eac5f985bd28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]
Nov 03 16:43:40 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.
Nov 03 16:43:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f223faf-7e44-4c3e-a07d-4b2712d89300]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b764d74-2af5-4987-a0f7-21a23a626fff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:43:40 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:43:40 user nova-compute[74932]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:43:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:43:40 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:43:40 user nova-compute[74932]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:43:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53cf63d-d4ca-448e-b666-5ab68dcf2431]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:43:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23062373638303864', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062373638303864', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'flavor' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:43:41 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:43:41 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:43:41 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:43:41 user nova-compute[74932]:   <serial>e844b6f6-757a-4036-ae09-8808f0cf1a9d</serial>
Nov 03 16:43:41 user nova-compute[74932]: </disk>
Nov 03 16:43:41 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:43:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No VIF found with MAC fa:16:3e:b6:9b:05, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:43:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ffcc1655-215b-40b6-bb43-0de13a542794 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.442s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:47 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:43:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:43:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:55 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing instance network info cache due to event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updated VIF entry in instance network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG nova.network.neutron [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:43:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8968a952-bb27-42d0-a9b5-ed4c5df4a6e0 req-c7e8a054-e402-4161-be06-8f91e666b906 service nova] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:43:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:43:57 user nova-compute[74932]: INFO nova.compute.manager [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Unrescuing
Nov 03 16:43:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:43:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:43:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG nova.network.neutron [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG nova.objects.instance [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'flavor' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-4344fda1-0578-4380-b5ef-2aae96fc54f5 req-ace6ba90-7fa4-4d2c-933a-28e7e03881c0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4344fda1-0578-4380-b5ef-2aae96fc54f5 req-ace6ba90-7fa4-4d2c-933a-28e7e03881c0 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4344fda1-0578-4380-b5ef-2aae96fc54f5 req-ace6ba90-7fa4-4d2c-933a-28e7e03881c0 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4344fda1-0578-4380-b5ef-2aae96fc54f5 req-ace6ba90-7fa4-4d2c-933a-28e7e03881c0 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-4344fda1-0578-4380-b5ef-2aae96fc54f5 req-ace6ba90-7fa4-4d2c-933a-28e7e03881c0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:43:58 user nova-compute[74932]: WARNING nova.compute.manager [req-4344fda1-0578-4380-b5ef-2aae96fc54f5 req-ace6ba90-7fa4-4d2c-933a-28e7e03881c0 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:43:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:43:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:43:59 user nova-compute[74932]: DEBUG nova.compute.manager [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing instance network info cache due to event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:43:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:43:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:43:59 user nova-compute[74932]: DEBUG nova.network.neutron [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:43:59 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance destroyed successfully.
Nov 03 16:44:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updated VIF entry in instance network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:44:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:44:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7c86c5d5-75b2-4525-9b93-ab1f43417d8b req-ce3c7516-ef06-44a9-8129-f1fcab07132f service nova] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:44:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-b4e94e52-8048-49cc-ba22-94522f24ca6d req-4a430688-0290-47b1-bb76-07861e283f03 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b4e94e52-8048-49cc-ba22-94522f24ca6d req-4a430688-0290-47b1-bb76-07861e283f03 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b4e94e52-8048-49cc-ba22-94522f24ca6d req-4a430688-0290-47b1-bb76-07861e283f03 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b4e94e52-8048-49cc-ba22-94522f24ca6d req-4a430688-0290-47b1-bb76-07861e283f03 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-b4e94e52-8048-49cc-ba22-94522f24ca6d req-4a430688-0290-47b1-bb76-07861e283f03 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:01 user nova-compute[74932]: WARNING nova.compute.manager [req-b4e94e52-8048-49cc-ba22-94522f24ca6d req-4a430688-0290-47b1-bb76-07861e283f03 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:44:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:02 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:44:02 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:03 user nova-compute[74932]: WARNING nova.compute.manager [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:44:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:03 user nova-compute[74932]: WARNING nova.compute.manager [req-510663cd-66a2-4943-8488-6d23c29ea156 req-0d1d7b73-f7aa-40ac-82c4-2ba4461e9504 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:44:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-552e948b-61b7-4358-90f7-3600734796dc tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:44:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:44:06 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:44:06 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:44:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8123MB free_disk=24.896961212158203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:44:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 7b1de337-1b43-473b-b929-5e4e357ba9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.881s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:44:10 user nova-compute[74932]: INFO nova.compute.claims [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Claim successful on node user
Nov 03 16:44:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:44:10 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:44:10 user nova-compute[74932]: DEBUG nova.policy [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90fa01b533204995b57b88b0a4aac138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8cbb942aff476ebf7cca3968447573', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:44:11 user nova-compute[74932]: INFO nova.virt.block_device [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Booting with volume 67345509-4a46-4c21-be0b-50f501f1ede2 at /dev/vda
Nov 03 16:44:11 user nova-compute[74932]: DEBUG os_brick.utils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d28dca-8312-4c60-9809-42d3fc822cb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5be6b7-75c0-49bb-8f01-d7e4ea3fc80b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aacec9-c12b-4257-8cb1-e5f9bd5da50d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8949e7cd-e13a-4aed-9cbb-666999f557f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:44:11 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d88d10b-33a1-4a21-9ea4-c5139323c54e]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG os_brick.utils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating existing volume attachment record: 04a10c94-4fbd-4f5e-8f75-28f02f1c18cf {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Successfully created port: a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:44:11 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Successfully updated port: a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquired lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-changed-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Refreshing instance network info cache due to event network-changed-a2df0959-c89f-418d-85b2-1b858d7aca5d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] Acquiring lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Releasing lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance network_info: |[{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] Acquired lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:44:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Refreshing network info cache for port a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:13 user nova-compute[74932]: INFO nova.compute.manager [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Rebooting instance
Nov 03 16:44:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updated VIF entry in instance network info cache for port a2df0959-c89f-418d-85b2-1b858d7aca5d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG nova.network.neutron [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-a8734b17-7766-460e-af41-cdcf7c5beef2 req-c1494d9b-c8ec-497a-926c-01d580afff77 service nova] Releasing lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG nova.compute.manager [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance destroyed successfully.
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.objects.instance [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'resources' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329843655',display_name='tempest-TestMinimumBasicScenario-server-1329843655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329843655',id=33,image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzIHQexU1m2W5QsFqd6Q7i8UiToJ5TQ321aeCEjlM8ySKJmAhlSMxg+P5IPxaD/sjXVZ5imyXrq7ejkhMBybtHu0n/rHm4RtCp6vX6nd8EGOCOBwj1JTjuQ6cQRJjOEtQ==',key_name='tempest-TestMinimumBasicScenario-928640101',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-psdcoxqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:44:14Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=7b1de337-1b43-473b-b929-5e4e357ba9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c6be14a-8f, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-unplugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-unplugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:14 user nova-compute[74932]: WARNING nova.compute.manager [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-unplugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.compute.manager [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:14 user nova-compute[74932]: WARNING nova.compute.manager [req-8e198035-9d5f-4220-952a-ab039d9a2932 req-7f21d360-3e36-468f-9087-113f059dd519 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06109221-1f9c-4343-b24c-512629e6e72d) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:44:14 user nova-compute[74932]: INFO os_vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f')
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:44:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e290c3-3984-41f9-b3e2-04827c6b0ebc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:44:14 user nova-compute[74932]: No targets found.
Nov 03 16:44:14 user nova-compute[74932]: iSNS:
Nov 03 16:44:14 user nova-compute[74932]: No targets found.
Nov 03 16:44:14 user nova-compute[74932]: STATIC:
Nov 03 16:44:14 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:44:14 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:44:14 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:44:14 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d
Nov 03 16:44:14 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:44:14 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:44:14 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced
Nov 03 16:44:14 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:44:14 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:44:14 user nova-compute[74932]: FIRMWARE:
Nov 03 16:44:14 user nova-compute[74932]: No targets found.
Nov 03 16:44:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:44:14 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:44:14 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0350b5f-713c-4d5a-a7de-2afa191e5540]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[17acd2ac-fd3d-4e33-91c6-1e89b52c5eec]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:14 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:14 user nova-compute[74932]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:14 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:14 user nova-compute[74932]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc641627a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c342193-721a-4a48-9f0f-98691e5c3be6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74c4d9-25bf-4c01-8fe7-150086dfe067]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3806fbff-5a49-4e7b-a2cf-c6c4b21c57fb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2b9694-51b3-43b0-b80b-cc0ddac60688]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[196822ac-9964-4b07-9819-7fe18df3a951]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4284080c-74a9-4607-bfbc-a7d7e3766fe7]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]
Nov 03 16:44:14 user nova-compute[74932]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.
Nov 03 16:44:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c291317f-12b9-4676-8eb8-4460eae3eb97]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== disconnect_volume: return (310ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:44:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Start _get_guest_xml network_info=[{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35e93787-0a72-4388-8e41-a72dba694e9e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '35e93787-0a72-4388-8e41-a72dba694e9e'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7b1de337-1b43-473b-b929-5e4e357ba9ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'serial': 'e844b6f6-757a-4036-ae09-8808f0cf1a9d'}, 'attachment_id': 'fb8a7e12-1daa-4a49-96db-5e456940a225', 'boot_index': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:44:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:44:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35e93787-0a72-4388-8e41-a72dba694e9e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.objects.instance [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.objects.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Object Instance<7b1de337-1b43-473b-b929-5e4e357ba9ac> lazy-loaded attributes: resources,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:44:15 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:44:15 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:44:15 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9a65c-4ef4-492b-bf95-f899dd005f60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:44:15 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b68625-4794-4c8d-9b1a-5e0c95ce0ea2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d] added
Nov 03 16:44:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1528f9-d250-49f1-ac59-8c875ec4fd62]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54f22e-8304-4b51-b092-ce6f9eca2bc1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqTpWgEC {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqTpWgEC" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a5fc79-2555-4073-958b-e7c7f18b997f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XqTpWgEC'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347b585-9ea9-42ff-a838-5b214027ba82]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0365571-c796-48fd-895d-aee415b73a06]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:15 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:15 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e774e8-0dfc-458b-9233-d82d81fa5f8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]
Nov 03 16:44:15 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.
Nov 03 16:44:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3cbca9-54c0-49d2-b619-92ecd8811f9f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5471611b-edb9-4908-8773-97e88a5ec0ae]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:15 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:15 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:15 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:15 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:15 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf871d-7653-4fc9-a9d4-150da307b4f6]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:44:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23062373638303864', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062373638303864', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329843655',display_name='tempest-TestMinimumBasicScenario-server-1329843655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329843655',id=33,image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzIHQexU1m2W5QsFqd6Q7i8UiToJ5TQ321aeCEjlM8ySKJmAhlSMxg+P5IPxaD/sjXVZ5imyXrq7ejkhMBybtHu0n/rHm4RtCp6vX6nd8EGOCOBwj1JTjuQ6cQRJjOEtQ==',key_name='tempest-TestMinimumBasicScenario-928640101',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-psdcoxqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:44:14Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=7b1de337-1b43-473b-b929-5e4e357ba9ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.objects.instance [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.objects.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Object Instance<7b1de337-1b43-473b-b929-5e4e357ba9ac> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:44:16 user nova-compute[74932]:   <uuid>7b1de337-1b43-473b-b929-5e4e357ba9ac</uuid>
Nov 03 16:44:16 user nova-compute[74932]:   <name>instance-00000021</name>
Nov 03 16:44:16 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:44:16 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:44:16 user nova-compute[74932]:   <metadata>
Nov 03 16:44:16 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:44:16 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:44:16 user nova-compute[74932]:       <nova:name>tempest-TestMinimumBasicScenario-server-1329843655</nova:name>
Nov 03 16:44:16 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:44:15</nova:creationTime>
Nov 03 16:44:16 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:44:16 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:44:16 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:44:16 user nova-compute[74932]:       <nova:owner>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:user uuid="fd1db8beca33482681f7d7b701d762f6">tempest-TestMinimumBasicScenario-62950615-project-member</nova:user>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:project uuid="a84af8fad5724ccc9e09836bcebb1ada">tempest-TestMinimumBasicScenario-62950615</nova:project>
Nov 03 16:44:16 user nova-compute[74932]:       </nova:owner>
Nov 03 16:44:16 user nova-compute[74932]:       <nova:root type="image" uuid="35e93787-0a72-4388-8e41-a72dba694e9e"/>
Nov 03 16:44:16 user nova-compute[74932]:       <nova:ports>
Nov 03 16:44:16 user nova-compute[74932]:         <nova:port uuid="5c6be14a-8f34-4ec5-8553-fa93ef13051d">
Nov 03 16:44:16 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 16:44:16 user nova-compute[74932]:         </nova:port>
Nov 03 16:44:16 user nova-compute[74932]:       </nova:ports>
Nov 03 16:44:16 user nova-compute[74932]:     </nova:instance>
Nov 03 16:44:16 user nova-compute[74932]:   </metadata>
Nov 03 16:44:16 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:44:16 user nova-compute[74932]:     <system>
Nov 03 16:44:16 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:44:16 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:44:16 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:44:16 user nova-compute[74932]:       <entry name="serial">7b1de337-1b43-473b-b929-5e4e357ba9ac</entry>
Nov 03 16:44:16 user nova-compute[74932]:       <entry name="uuid">7b1de337-1b43-473b-b929-5e4e357ba9ac</entry>
Nov 03 16:44:16 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:44:16 user nova-compute[74932]:     </system>
Nov 03 16:44:16 user nova-compute[74932]:   </sysinfo>
Nov 03 16:44:16 user nova-compute[74932]:   <os>
Nov 03 16:44:16 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:44:16 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:44:16 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:44:16 user nova-compute[74932]:   </os>
Nov 03 16:44:16 user nova-compute[74932]:   <features>
Nov 03 16:44:16 user nova-compute[74932]:     <acpi/>
Nov 03 16:44:16 user nova-compute[74932]:     <apic/>
Nov 03 16:44:16 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:44:16 user nova-compute[74932]:   </features>
Nov 03 16:44:16 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:44:16 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:44:16 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:44:16 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:44:16 user nova-compute[74932]:   </clock>
Nov 03 16:44:16 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:44:16 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:44:16 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:44:16 user nova-compute[74932]:   </cpu>
Nov 03 16:44:16 user nova-compute[74932]:   <devices>
Nov 03 16:44:16 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:44:16 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:44:16 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk"/>
Nov 03 16:44:16 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:44:16 user nova-compute[74932]:     </disk>
Nov 03 16:44:16 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:44:16 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:44:16 user nova-compute[74932]:       <source dev="/dev/sdd"/>
Nov 03 16:44:16 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:44:16 user nova-compute[74932]:       <serial>e844b6f6-757a-4036-ae09-8808f0cf1a9d</serial>
Nov 03 16:44:16 user nova-compute[74932]:     </disk>
Nov 03 16:44:16 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:44:16 user nova-compute[74932]:       <mac address="fa:16:3e:b6:9b:05"/>
Nov 03 16:44:16 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:44:16 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:44:16 user nova-compute[74932]:       <target dev="tap5c6be14a-8f"/>
Nov 03 16:44:16 user nova-compute[74932]:     </interface>
Nov 03 16:44:16 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:44:16 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/console.log" append="off"/>
Nov 03 16:44:16 user nova-compute[74932]:     </serial>
Nov 03 16:44:16 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:44:16 user nova-compute[74932]:     <video>
Nov 03 16:44:16 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:44:16 user nova-compute[74932]:     </video>
Nov 03 16:44:16 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:44:16 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:44:16 user nova-compute[74932]:     </rng>
Nov 03 16:44:16 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:44:16 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:44:16 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:44:16 user nova-compute[74932]:     </memballoon>
Nov 03 16:44:16 user nova-compute[74932]:   </devices>
Nov 03 16:44:16 user nova-compute[74932]: </domain>
Nov 03 16:44:16 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:44:16 user nova-compute[74932]: DEBUG nova.objects.instance [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.objects.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Object Instance<7b1de337-1b43-473b-b929-5e4e357ba9ac> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc443a77dcfdacc08bbb39b504ee21a46695482 --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Cannot resize image /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.objects.instance [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'migration_context' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.objects.base [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Object Instance<7b1de337-1b43-473b-b929-5e4e357ba9ac> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329843655',display_name='tempest-TestMinimumBasicScenario-server-1329843655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329843655',id=33,image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzIHQexU1m2W5QsFqd6Q7i8UiToJ5TQ321aeCEjlM8ySKJmAhlSMxg+P5IPxaD/sjXVZ5imyXrq7ejkhMBybtHu0n/rHm4RtCp6vX6nd8EGOCOBwj1JTjuQ6cQRJjOEtQ==',key_name='tempest-TestMinimumBasicScenario-928640101',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-psdcoxqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:44:14Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=7b1de337-1b43-473b-b929-5e4e357ba9ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG os_vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ecc091a-518d-51b9-b9c8-2c31fdfca41e', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c6be14a-8f, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c6be14a-8f, col_values=(('qos', UUID('d21745b2-f90a-42c9-af87-a74059d5fcec')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c6be14a-8f, col_values=(('external_ids', {'iface-id': '5c6be14a-8f34-4ec5-8553-fa93ef13051d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9b:05', 'vm-uuid': '7b1de337-1b43-473b-b929-5e4e357ba9ac'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:44:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:17 user nova-compute[74932]: INFO os_vif [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f')
Nov 03 16:44:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-954565c0-6fd5-40b2-90a3-03d0b9dfe12d req-186b54ab-4ce6-4779-834f-296c1481b016 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-954565c0-6fd5-40b2-90a3-03d0b9dfe12d req-186b54ab-4ce6-4779-834f-296c1481b016 service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-954565c0-6fd5-40b2-90a3-03d0b9dfe12d req-186b54ab-4ce6-4779-834f-296c1481b016 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-954565c0-6fd5-40b2-90a3-03d0b9dfe12d req-186b54ab-4ce6-4779-834f-296c1481b016 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-954565c0-6fd5-40b2-90a3-03d0b9dfe12d req-186b54ab-4ce6-4779-834f-296c1481b016 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:19 user nova-compute[74932]: WARNING nova.compute.manager [req-954565c0-6fd5-40b2-90a3-03d0b9dfe12d req-186b54ab-4ce6-4779-834f-296c1481b016 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 16:44:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:19 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:44:21 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance rebooted successfully.
Nov 03 16:44:21 user nova-compute[74932]: DEBUG nova.compute.manager [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:44:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5be2223-e88e-4980-a252-a269a3ca1d76 req-bab54e6e-c4c9-4ddf-8f49-cb9fdc9b5462 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5be2223-e88e-4980-a252-a269a3ca1d76 req-bab54e6e-c4c9-4ddf-8f49-cb9fdc9b5462 service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5be2223-e88e-4980-a252-a269a3ca1d76 req-bab54e6e-c4c9-4ddf-8f49-cb9fdc9b5462 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b5be2223-e88e-4980-a252-a269a3ca1d76 req-bab54e6e-c4c9-4ddf-8f49-cb9fdc9b5462 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:21 user nova-compute[74932]: DEBUG nova.compute.manager [req-b5be2223-e88e-4980-a252-a269a3ca1d76 req-bab54e6e-c4c9-4ddf-8f49-cb9fdc9b5462 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:21 user nova-compute[74932]: WARNING nova.compute.manager [req-b5be2223-e88e-4980-a252-a269a3ca1d76 req-bab54e6e-c4c9-4ddf-8f49-cb9fdc9b5462 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 16:44:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-574d9185-fcfa-4f89-8392-6a8505d613d8 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.037s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:44:33 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Creating image(s)
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Ensure instance console log exists: /opt/stack/data/nova/instances/36b59795-c633-412e-92f4-280e6daeec54/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Start _get_guest_xml network_info=[{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36b59795-c633-412e-92f4-280e6daeec54', 'attached_at': '', 'detached_at': '', 'volume_id': '67345509-4a46-4c21-be0b-50f501f1ede2', 'serial': '67345509-4a46-4c21-be0b-50f501f1ede2'}, 'attachment_id': '04a10c94-4fbd-4f5e-8f75-28f02f1c18cf', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:44:33 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:44:33 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:44:33 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:44:33 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:44:33 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dbec54-ef78-4a7b-be0f-b6e1b50ce3a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:44:33 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c9a7c-513c-4885-b6b0-2fa5d3835ffe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2] added
Nov 03 16:44:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a6e21-ee7a-4770-8bef-953c7647ab39]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa6209-127d-4475-b711-62f36d55b6bb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBtYagPF {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBtYagPF" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[272bbb47-4468-4ccb-9ae7-ba7d276b39a6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBtYagPF'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f112be8f-6115-49a4-a6b7-9b389fea52e9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209f6d3-a1fe-48b6-a251-6173955536f8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[869cd36a-b59a-4ba9-9831-2e09633c64b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]
Nov 03 16:44:33 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.
Nov 03 16:44:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f44b17-b2ad-4ad8-b445-6892ba5b614c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ebe5bf-9b50-433c-93fc-48d769ab70dc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:44:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:44:33 user nova-compute[74932]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:44:33 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[698f85cf-b719-40f2-9d57-1b72f76dd2ed]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:44:33 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23837306139346232', 'path': '/dev/sde'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837306139346232', 'path': '/dev/sde'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-681209233',display_name='tempest-ServerActionsTestOtherA-server-681209233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-681209233',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-udx1o824',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=36b59795-c633-412e-92f4-280e6daeec54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG nova.objects.instance [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'pci_devices' on Instance uuid 36b59795-c633-412e-92f4-280e6daeec54 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:44:34 user nova-compute[74932]:   <uuid>36b59795-c633-412e-92f4-280e6daeec54</uuid>
Nov 03 16:44:34 user nova-compute[74932]:   <name>instance-00000023</name>
Nov 03 16:44:34 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:44:34 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:44:34 user nova-compute[74932]:   <metadata>
Nov 03 16:44:34 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:44:34 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:44:34 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherA-server-681209233</nova:name>
Nov 03 16:44:34 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:44:33</nova:creationTime>
Nov 03 16:44:34 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:44:34 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:44:34 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:44:34 user nova-compute[74932]:       <nova:owner>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:user uuid="90fa01b533204995b57b88b0a4aac138">tempest-ServerActionsTestOtherA-1516695200-project-member</nova:user>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:project uuid="9a8cbb942aff476ebf7cca3968447573">tempest-ServerActionsTestOtherA-1516695200</nova:project>
Nov 03 16:44:34 user nova-compute[74932]:       </nova:owner>
Nov 03 16:44:34 user nova-compute[74932]:       <nova:ports>
Nov 03 16:44:34 user nova-compute[74932]:         <nova:port uuid="a2df0959-c89f-418d-85b2-1b858d7aca5d">
Nov 03 16:44:34 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 16:44:34 user nova-compute[74932]:         </nova:port>
Nov 03 16:44:34 user nova-compute[74932]:       </nova:ports>
Nov 03 16:44:34 user nova-compute[74932]:     </nova:instance>
Nov 03 16:44:34 user nova-compute[74932]:   </metadata>
Nov 03 16:44:34 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:44:34 user nova-compute[74932]:     <system>
Nov 03 16:44:34 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:44:34 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:44:34 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:44:34 user nova-compute[74932]:       <entry name="serial">36b59795-c633-412e-92f4-280e6daeec54</entry>
Nov 03 16:44:34 user nova-compute[74932]:       <entry name="uuid">36b59795-c633-412e-92f4-280e6daeec54</entry>
Nov 03 16:44:34 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:44:34 user nova-compute[74932]:     </system>
Nov 03 16:44:34 user nova-compute[74932]:   </sysinfo>
Nov 03 16:44:34 user nova-compute[74932]:   <os>
Nov 03 16:44:34 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:44:34 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:44:34 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:44:34 user nova-compute[74932]:   </os>
Nov 03 16:44:34 user nova-compute[74932]:   <features>
Nov 03 16:44:34 user nova-compute[74932]:     <acpi/>
Nov 03 16:44:34 user nova-compute[74932]:     <apic/>
Nov 03 16:44:34 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:44:34 user nova-compute[74932]:   </features>
Nov 03 16:44:34 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:44:34 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:44:34 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:44:34 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:44:34 user nova-compute[74932]:   </clock>
Nov 03 16:44:34 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:44:34 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:44:34 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:44:34 user nova-compute[74932]:   </cpu>
Nov 03 16:44:34 user nova-compute[74932]:   <devices>
Nov 03 16:44:34 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:44:34 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:44:34 user nova-compute[74932]:       <source dev="/dev/sde"/>
Nov 03 16:44:34 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:44:34 user nova-compute[74932]:       <serial>67345509-4a46-4c21-be0b-50f501f1ede2</serial>
Nov 03 16:44:34 user nova-compute[74932]:     </disk>
Nov 03 16:44:34 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:44:34 user nova-compute[74932]:       <mac address="fa:16:3e:cd:fd:a3"/>
Nov 03 16:44:34 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:44:34 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:44:34 user nova-compute[74932]:       <target dev="tapa2df0959-c8"/>
Nov 03 16:44:34 user nova-compute[74932]:     </interface>
Nov 03 16:44:34 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:44:34 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/36b59795-c633-412e-92f4-280e6daeec54/console.log" append="off"/>
Nov 03 16:44:34 user nova-compute[74932]:     </serial>
Nov 03 16:44:34 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:44:34 user nova-compute[74932]:     <video>
Nov 03 16:44:34 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:44:34 user nova-compute[74932]:     </video>
Nov 03 16:44:34 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:44:34 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:44:34 user nova-compute[74932]:     </rng>
Nov 03 16:44:34 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:44:34 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:44:34 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:44:34 user nova-compute[74932]:     </memballoon>
Nov 03 16:44:34 user nova-compute[74932]:   </devices>
Nov 03 16:44:34 user nova-compute[74932]: </domain>
Nov 03 16:44:34 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-681209233',display_name='tempest-ServerActionsTestOtherA-server-681209233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-681209233',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-udx1o824',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=36b59795-c633-412e-92f4-280e6daeec54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG os_vif [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6041acc-61ff-5a20-85b8-e2d60b5165ad', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2df0959-c8, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2df0959-c8, col_values=(('qos', UUID('18851bb8-2d93-4c4a-84c6-3896c164d173')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2df0959-c8, col_values=(('external_ids', {'iface-id': 'a2df0959-c89f-418d-85b2-1b858d7aca5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:fd:a3', 'vm-uuid': '36b59795-c633-412e-92f4-280e6daeec54'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:35 user nova-compute[74932]: INFO os_vif [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8')
Nov 03 16:44:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:44:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No VIF found with MAC fa:16:3e:cd:fd:a3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:44:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-d46395f9-8489-467e-b926-53f0b8bb079e req-8466909a-5533-40d1-a56a-ad72e59f74b2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d46395f9-8489-467e-b926-53f0b8bb079e req-8466909a-5533-40d1-a56a-ad72e59f74b2 service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d46395f9-8489-467e-b926-53f0b8bb079e req-8466909a-5533-40d1-a56a-ad72e59f74b2 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d46395f9-8489-467e-b926-53f0b8bb079e req-8466909a-5533-40d1-a56a-ad72e59f74b2 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-d46395f9-8489-467e-b926-53f0b8bb079e req-8466909a-5533-40d1-a56a-ad72e59f74b2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:37 user nova-compute[74932]: WARNING nova.compute.manager [req-d46395f9-8489-467e-b926-53f0b8bb079e req-8466909a-5533-40d1-a56a-ad72e59f74b2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state building and task_state spawning.
Nov 03 16:44:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:44:38 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance spawned successfully.
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:44:38 user nova-compute[74932]: INFO nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 03 16:44:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:44:39 user nova-compute[74932]: INFO nova.compute.manager [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Took 28.90 seconds to build instance.
Nov 03 16:44:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-4b854aeb-e4ad-4b94-83f1-3d6ff73cd044 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.004s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-87944686-b51f-490f-bb88-6ee9255e5893 req-5db90e99-303c-4687-9633-734634accfd4 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:44:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-87944686-b51f-490f-bb88-6ee9255e5893 req-5db90e99-303c-4687-9633-734634accfd4 service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:44:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-87944686-b51f-490f-bb88-6ee9255e5893 req-5db90e99-303c-4687-9633-734634accfd4 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:44:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-87944686-b51f-490f-bb88-6ee9255e5893 req-5db90e99-303c-4687-9633-734634accfd4 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:44:39 user nova-compute[74932]: DEBUG nova.compute.manager [req-87944686-b51f-490f-bb88-6ee9255e5893 req-5db90e99-303c-4687-9633-734634accfd4 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:44:39 user nova-compute[74932]: WARNING nova.compute.manager [req-87944686-b51f-490f-bb88-6ee9255e5893 req-5db90e99-303c-4687-9633-734634accfd4 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state active and task_state None.
Nov 03 16:44:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:49 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:44:54 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:44:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:44:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [{"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:44:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-1ed9acd4-1794-429c-9c37-84a58024947c" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:44:55 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:44:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:44:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:44:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:45:03 user nova-compute[74932]: INFO nova.compute.manager [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] instance snapshotting
Nov 03 16:45:03 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Beginning live snapshot process
Nov 03 16:45:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json -f qcow2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json -f qcow2" returned: 0 in 0.239s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.177s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcmyyspz8/d6b8f5dc25d24ba6975c55021bef03b2.delta 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:45:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcmyyspz8/d6b8f5dc25d24ba6975c55021bef03b2.delta 1073741824" returned: 0 in 0.109s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 16:45:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:45:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74932) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 16:45:05 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 16:45:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcmyyspz8/d6b8f5dc25d24ba6975c55021bef03b2.delta /opt/stack/data/nova/instances/snapshots/tmpcmyyspz8/d6b8f5dc25d24ba6975c55021bef03b2 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcmyyspz8/d6b8f5dc25d24ba6975c55021bef03b2.delta /opt/stack/data/nova/instances/snapshots/tmpcmyyspz8/d6b8f5dc25d24ba6975c55021bef03b2" returned: 0 in 0.367s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:06 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Snapshot extracted, beginning image upload
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:45:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:45:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=24.882610321044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:09 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Snapshot image upload complete
Nov 03 16:45:09 user nova-compute[74932]: INFO nova.compute.manager [None req-5b19829f-fc12-4ec6-99dc-8df3eed7f7c7 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Took 5.68 seconds to snapshot the instance on the hypervisor.
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 7b1de337-1b43-473b-b929-5e4e357ba9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 36b59795-c633-412e-92f4-280e6daeec54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:45:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:12 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "2eaa8ccb-1e13-434c-9152-07b866607713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:39 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:45:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:39 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:39 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:45:39 user nova-compute[74932]: INFO nova.compute.claims [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Claim successful on node user
Nov 03 16:45:39 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.network.neutron [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:45:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:45:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Creating image(s)
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "/opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "/opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "/opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.policy [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60afe1b4e23040fa826b96680e727540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da40a37a92e429d93abd5f05a514837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk 1073741824" returned: 0 in 0.059s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:45:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Cannot resize image /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Ensure instance console log exists: /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Successfully created port: ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Successfully updated port: ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "refresh_cache-2eaa8ccb-1e13-434c-9152-07b866607713" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquired lock "refresh_cache-2eaa8ccb-1e13-434c-9152-07b866607713" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-changed-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Refreshing instance network info cache due to event network-changed-ba408bbf-90a4-4885-a4ab-2342d5e332d2. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] Acquiring lock "refresh_cache-2eaa8ccb-1e13-434c-9152-07b866607713" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:41 user nova-compute[74932]: DEBUG nova.network.neutron [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.neutron [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Updating instance_info_cache with network_info: [{"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Releasing lock "refresh_cache-2eaa8ccb-1e13-434c-9152-07b866607713" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Instance network_info: |[{"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] Acquired lock "refresh_cache-2eaa8ccb-1e13-434c-9152-07b866607713" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Refreshing network info cache for port ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Start _get_guest_xml network_info=[{"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:45:42 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:45:42 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1017097998',display_name='tempest-VolumesNegativeTest-instance-1017097998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1017097998',id=36,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7da40a37a92e429d93abd5f05a514837',ramdisk_id='',reservation_id='r-a2rux8jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-948565881',owner_user_name='tempest-VolumesNegativeTest-948565881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:45:40Z,user_data=None,user_id='60afe1b4e23040fa826b96680e727540',uuid=2eaa8ccb-1e13-434c-9152-07b866607713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Converting VIF {"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.objects.instance [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lazy-loading 'pci_devices' on Instance uuid 2eaa8ccb-1e13-434c-9152-07b866607713 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:45:42 user nova-compute[74932]:   <uuid>2eaa8ccb-1e13-434c-9152-07b866607713</uuid>
Nov 03 16:45:42 user nova-compute[74932]:   <name>instance-00000024</name>
Nov 03 16:45:42 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:45:42 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:45:42 user nova-compute[74932]:   <metadata>
Nov 03 16:45:42 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:45:42 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:45:42 user nova-compute[74932]:       <nova:name>tempest-VolumesNegativeTest-instance-1017097998</nova:name>
Nov 03 16:45:42 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:45:42</nova:creationTime>
Nov 03 16:45:42 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:45:42 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:45:42 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:45:42 user nova-compute[74932]:       <nova:owner>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:user uuid="60afe1b4e23040fa826b96680e727540">tempest-VolumesNegativeTest-948565881-project-member</nova:user>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:project uuid="7da40a37a92e429d93abd5f05a514837">tempest-VolumesNegativeTest-948565881</nova:project>
Nov 03 16:45:42 user nova-compute[74932]:       </nova:owner>
Nov 03 16:45:42 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:45:42 user nova-compute[74932]:       <nova:ports>
Nov 03 16:45:42 user nova-compute[74932]:         <nova:port uuid="ba408bbf-90a4-4885-a4ab-2342d5e332d2">
Nov 03 16:45:42 user nova-compute[74932]:           <nova:ip type="fixed" address="192.168.233.163" ipVersion="4"/>
Nov 03 16:45:42 user nova-compute[74932]:         </nova:port>
Nov 03 16:45:42 user nova-compute[74932]:       </nova:ports>
Nov 03 16:45:42 user nova-compute[74932]:     </nova:instance>
Nov 03 16:45:42 user nova-compute[74932]:   </metadata>
Nov 03 16:45:42 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:45:42 user nova-compute[74932]:     <system>
Nov 03 16:45:42 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:45:42 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:45:42 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:45:42 user nova-compute[74932]:       <entry name="serial">2eaa8ccb-1e13-434c-9152-07b866607713</entry>
Nov 03 16:45:42 user nova-compute[74932]:       <entry name="uuid">2eaa8ccb-1e13-434c-9152-07b866607713</entry>
Nov 03 16:45:42 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:45:42 user nova-compute[74932]:     </system>
Nov 03 16:45:42 user nova-compute[74932]:   </sysinfo>
Nov 03 16:45:42 user nova-compute[74932]:   <os>
Nov 03 16:45:42 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:45:42 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:45:42 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:45:42 user nova-compute[74932]:   </os>
Nov 03 16:45:42 user nova-compute[74932]:   <features>
Nov 03 16:45:42 user nova-compute[74932]:     <acpi/>
Nov 03 16:45:42 user nova-compute[74932]:     <apic/>
Nov 03 16:45:42 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:45:42 user nova-compute[74932]:   </features>
Nov 03 16:45:42 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:45:42 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:45:42 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:45:42 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:45:42 user nova-compute[74932]:   </clock>
Nov 03 16:45:42 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:45:42 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:45:42 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:45:42 user nova-compute[74932]:   </cpu>
Nov 03 16:45:42 user nova-compute[74932]:   <devices>
Nov 03 16:45:42 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:45:42 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:45:42 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk"/>
Nov 03 16:45:42 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:45:42 user nova-compute[74932]:     </disk>
Nov 03 16:45:42 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:45:42 user nova-compute[74932]:       <mac address="fa:16:3e:3b:f6:ed"/>
Nov 03 16:45:42 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:45:42 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:45:42 user nova-compute[74932]:       <target dev="tapba408bbf-90"/>
Nov 03 16:45:42 user nova-compute[74932]:     </interface>
Nov 03 16:45:42 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:45:42 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/console.log" append="off"/>
Nov 03 16:45:42 user nova-compute[74932]:     </serial>
Nov 03 16:45:42 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:45:42 user nova-compute[74932]:     <video>
Nov 03 16:45:42 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:45:42 user nova-compute[74932]:     </video>
Nov 03 16:45:42 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:45:42 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:45:42 user nova-compute[74932]:     </rng>
Nov 03 16:45:42 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:45:42 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:45:42 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:45:42 user nova-compute[74932]:     </memballoon>
Nov 03 16:45:42 user nova-compute[74932]:   </devices>
Nov 03 16:45:42 user nova-compute[74932]: </domain>
Nov 03 16:45:42 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1017097998',display_name='tempest-VolumesNegativeTest-instance-1017097998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1017097998',id=36,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7da40a37a92e429d93abd5f05a514837',ramdisk_id='',reservation_id='r-a2rux8jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-948565881',owner_user_name='tempest-VolumesNegativeTest-948565881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:45:40Z,user_data=None,user_id='60afe1b4e23040fa826b96680e727540',uuid=2eaa8ccb-1e13-434c-9152-07b866607713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Converting VIF {"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG os_vif [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8610eaee-c8d5-5378-ac7e-64b9da64aa05', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba408bbf-90, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba408bbf-90, col_values=(('qos', UUID('ef058654-4aa4-4e6b-9b7b-bd7259734e82')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba408bbf-90, col_values=(('external_ids', {'iface-id': 'ba408bbf-90a4-4885-a4ab-2342d5e332d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f6:ed', 'vm-uuid': '2eaa8ccb-1e13-434c-9152-07b866607713'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:42 user nova-compute[74932]: INFO os_vif [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90')
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] No VIF found with MAC fa:16:3e:3b:f6:ed, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Updated VIF entry in instance network info cache for port ba408bbf-90a4-4885-a4ab-2342d5e332d2. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Updating instance_info_cache with network_info: [{"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c1e1b2bd-2361-4abc-97f3-2ba50cb956a1 req-f1a216b8-b42a-468c-95f2-d3e234d50985 service nova] Releasing lock "refresh_cache-2eaa8ccb-1e13-434c-9152-07b866607713" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-10ee2eb7-d67a-4787-8d4b-909f1593c83e req-ae777ed4-3bac-4730-bac4-49c9013b7357 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-10ee2eb7-d67a-4787-8d4b-909f1593c83e req-ae777ed4-3bac-4730-bac4-49c9013b7357 service nova] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-10ee2eb7-d67a-4787-8d4b-909f1593c83e req-ae777ed4-3bac-4730-bac4-49c9013b7357 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-10ee2eb7-d67a-4787-8d4b-909f1593c83e req-ae777ed4-3bac-4730-bac4-49c9013b7357 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-10ee2eb7-d67a-4787-8d4b-909f1593c83e req-ae777ed4-3bac-4730-bac4-49c9013b7357 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] No waiting events found dispatching network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:45:44 user nova-compute[74932]: WARNING nova.compute.manager [req-10ee2eb7-d67a-4787-8d4b-909f1593c83e req-ae777ed4-3bac-4730-bac4-49c9013b7357 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received unexpected event network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 for instance with vm_state building and task_state spawning.
Nov 03 16:45:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:45:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Instance spawned successfully.
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:45:45 user nova-compute[74932]: INFO nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 03 16:45:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:45:46 user nova-compute[74932]: INFO nova.compute.manager [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Took 6.47 seconds to build instance.
Nov 03 16:45:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-52b02931-7858-499f-a92b-720992ce26a2 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "2eaa8ccb-1e13-434c-9152-07b866607713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.564s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-805d909f-6a76-40d0-9bf5-4ba78db9dcfa req-e4fdb31f-bbb1-4752-a0c9-52dcf50d0dc7 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:45:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-805d909f-6a76-40d0-9bf5-4ba78db9dcfa req-e4fdb31f-bbb1-4752-a0c9-52dcf50d0dc7 service nova] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-805d909f-6a76-40d0-9bf5-4ba78db9dcfa req-e4fdb31f-bbb1-4752-a0c9-52dcf50d0dc7 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-805d909f-6a76-40d0-9bf5-4ba78db9dcfa req-e4fdb31f-bbb1-4752-a0c9-52dcf50d0dc7 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-805d909f-6a76-40d0-9bf5-4ba78db9dcfa req-e4fdb31f-bbb1-4752-a0c9-52dcf50d0dc7 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] No waiting events found dispatching network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:45:46 user nova-compute[74932]: WARNING nova.compute.manager [req-805d909f-6a76-40d0-9bf5-4ba78db9dcfa req-e4fdb31f-bbb1-4752-a0c9-52dcf50d0dc7 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received unexpected event network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 for instance with vm_state active and task_state None.
Nov 03 16:45:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e6e6600c-2878-4318-983a-929b353da7f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:45:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:47 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:45:47 user nova-compute[74932]: INFO nova.compute.claims [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Claim successful on node user
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.network.neutron [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:45:48 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:45:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:45:48 user nova-compute[74932]: DEBUG nova.policy [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd7108d051f4052882dc2855457da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111f571583f844359234fa4760d45a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:45:48 user nova-compute[74932]: INFO nova.virt.block_device [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Booting with volume snapshot 157fee7e-fb47-4a86-b6fd-c2ff2724ab9e at /dev/vda
Nov 03 16:45:49 user nova-compute[74932]: DEBUG nova.network.neutron [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Successfully created port: 071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:45:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:45:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing instance network info cache due to event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:45:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:49 user nova-compute[74932]: DEBUG nova.network.neutron [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:45:49 user nova-compute[74932]: DEBUG nova.network.neutron [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Successfully updated port: 071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "refresh_cache-e6e6600c-2878-4318-983a-929b353da7f7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquired lock "refresh_cache-e6e6600c-2878-4318-983a-929b353da7f7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-changed-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.compute.manager [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Refreshing instance network info cache due to event network-changed-071c468c-f474-4eea-a67d-0a6a8b79805a. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] Acquiring lock "refresh_cache-e6e6600c-2878-4318-983a-929b353da7f7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Updating instance_info_cache with network_info: [{"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Releasing lock "refresh_cache-e6e6600c-2878-4318-983a-929b353da7f7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Instance network_info: |[{"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] Acquired lock "refresh_cache-e6e6600c-2878-4318-983a-929b353da7f7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Refreshing network info cache for port 071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updated VIF entry in instance network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-229b1e4e-e555-418a-ba7f-61f924c271c7 req-5d1a0d12-8fe1-405b-b0af-69b114c09c57 service nova] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:45:50 user nova-compute[74932]: INFO nova.compute.manager [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Detaching volume 04a8ab47-5482-4fda-9ea1-074960d43ced
Nov 03 16:45:50 user nova-compute[74932]: INFO nova.virt.block_device [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Attempting to driver detach volume 04a8ab47-5482-4fda-9ea1-074960d43ced from mountpoint /dev/vdb
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Attempting to detach device vdb from instance 77b76574-4898-49f8-aaee-cff8f7e11b6e from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:45:50 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:45:50 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:45:50 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:45:50 user nova-compute[74932]:   <serial>04a8ab47-5482-4fda-9ea1-074960d43ced</serial>
Nov 03 16:45:50 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:45:50 user nova-compute[74932]: </disk>
Nov 03 16:45:50 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:45:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully detached device vdb from instance 77b76574-4898-49f8-aaee-cff8f7e11b6e from the persistent domain config.
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77b76574-4898-49f8-aaee-cff8f7e11b6e from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:45:50 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:45:50 user nova-compute[74932]:   <source dev="/dev/sdc"/>
Nov 03 16:45:50 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:45:50 user nova-compute[74932]:   <serial>04a8ab47-5482-4fda-9ea1-074960d43ced</serial>
Nov 03 16:45:50 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:45:50 user nova-compute[74932]: </disk>
Nov 03 16:45:50 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Updated VIF entry in instance network info cache for port 071c468c-f474-4eea-a67d-0a6a8b79805a. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG nova.network.neutron [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Updating instance_info_cache with network_info: [{"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-125305a6-5991-4daf-9432-2e97ba0eee80 req-2d516032-ee7f-4edb-84b1-2c667639006b service nova] Releasing lock "refresh_cache-e6e6600c-2878-4318-983a-929b353da7f7" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:45:51 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:45:51 user nova-compute[74932]: DEBUG nova.compute.manager [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing instance network info cache due to event network-changed-3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] Acquiring lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] Acquired lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Refreshing network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updated VIF entry in instance network info cache for port 3e54265e-4ed1-4af7-85d6-033ddbae3b7b. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [{"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7456388b-b199-4048-b8f8-cd51a23c2e55 req-3b55f8f2-8d45-466d-862b-654c0a5ad1c6 service nova] Releasing lock "refresh_cache-77b76574-4898-49f8-aaee-cff8f7e11b6e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG os_brick.utils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ad2dee-9e54-4ea8-adab-41053f5c3e3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[54debd09-e86f-42ea-89a5-e3d4dcd52601]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eeb3e6-e2bb-44b1-b9c8-6d580fe97695]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07fef04-c3f7-4d01-86f3-65024d9f454f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:45:54 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ac7de-575b-40f6-bb14-14754ab261c4]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG os_brick.utils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Updating existing volume attachment record: 270e9749-2433-4534-a5b4-95117bd17d65 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:45:54 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:45:55 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [{"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:45:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-16bb1633-adf9-4889-a809-3e4eac1071b9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:45:55 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:45:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:45:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:45:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:45:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-changed-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG nova.compute.manager [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Refreshing instance network info cache due to event network-changed-0c575c5b-4834-49fc-85bc-19b531842c25. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Refreshing network info cache for port 0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updated VIF entry in instance network info cache for port 0c575c5b-4834-49fc-85bc-19b531842c25. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG nova.network.neutron [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-22adc847-3027-44d9-b180-75e7bcb53ec0 req-6563dcf0-2da9-404c-a29d-51acfa1fa634 service nova] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Stashing vm_state: active {{(pid=74932) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 16:46:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:46:03 user nova-compute[74932]: INFO nova.compute.claims [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Claim successful on node user
Nov 03 16:46:03 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating resource usage from migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81
Nov 03 16:46:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-changed-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.compute.manager [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Refreshing instance network info cache due to event network-changed-a2df0959-c89f-418d-85b2-1b858d7aca5d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] Acquiring lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] Acquired lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.network.neutron [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Refreshing network info cache for port a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.414s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:03 user nova-compute[74932]: INFO nova.compute.manager [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Migrating
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.network.neutron [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updated VIF entry in instance network info cache for port a2df0959-c89f-418d-85b2-1b858d7aca5d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.network.neutron [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f2b448b3-e23a-4645-a2e8-c3f3bf7b5b0f req-d85f12d8-f403-4952-ad1e-7963f3d4a6a2 service nova] Releasing lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquired lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Releasing lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Starting migrate_disk_and_power_off {{(pid=74932) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:46:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance destroyed successfully.
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-681209233',display_name='tempest-ServerActionsTestOtherA-server-681209233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-681209233',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-udx1o824',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=36b59795-c633-412e-92f4-280e6daeec54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG os_vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2df0959-c8, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18851bb8-2d93-4c4a-84c6-3896c164d173) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:04 user nova-compute[74932]: INFO os_vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8')
Nov 03 16:46:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:04 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[431fc425-7639-4d4d-a8b9-1cfcdfd1f9a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:46:05 user nova-compute[74932]: No targets found.
Nov 03 16:46:05 user nova-compute[74932]: iSNS:
Nov 03 16:46:05 user nova-compute[74932]: No targets found.
Nov 03 16:46:05 user nova-compute[74932]: STATIC:
Nov 03 16:46:05 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:46:05 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:05 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:05 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2
Nov 03 16:46:05 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:05 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:05 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d
Nov 03 16:46:05 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:05 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:05 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced
Nov 03 16:46:05 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:05 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:05 user nova-compute[74932]: FIRMWARE:
Nov 03 16:46:05 user nova-compute[74932]: No targets found.
Nov 03 16:46:05 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:46:05 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:46:05 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c086e46-0712-40a3-94f2-ca8062edbebd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9be2ef-46d0-43e4-a673-2d25fef7b5e6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:05 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:46:05 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:05 user nova-compute[74932]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:05 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:05 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:46:05 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:05 user nova-compute[74932]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:05 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc8410d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2'): ({'sde'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Removing single pathed devices sde {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b007153f-1c23-4faf-a381-455259c3d1be]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d34473-d5e2-421f-962d-c091b560a1c3]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flushing IO for device /dev/sde {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb605a-26a5-4420-a779-559817860d26]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53febb8-470c-46d9-b319-80da69c90c54]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23837306139346232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_25003908') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 16:46:05 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23837306139346232
Nov 03 16:46:05 user nova-compute[74932]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_25003908
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0001f018-e5e3-4fb5-9e18-ae670eeda212]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef3519-a0bc-455c-9318-9ecb9e6ee7f8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec80b81-29db-4017-850f-2a1c4f0cf1b3]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]
Nov 03 16:46:05 user nova-compute[74932]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.
Nov 03 16:46:05 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-unplugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-unplugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:05 user nova-compute[74932]: WARNING nova.compute.manager [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-unplugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state active and task_state resize_migrating.
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:05 user nova-compute[74932]: WARNING nova.compute.manager [req-008cd69f-7d26-456c-a507-c9e3177f7345 req-d9e8d6dc-6902-4154-89e8-96b39d3608da service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state active and task_state resize_migrating.
Nov 03 16:46:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6d61d-41b3-474d-b766-1abd422d72d5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== disconnect_volume: return (409ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing instance network info cache due to event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updated VIF entry in instance network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:46:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fcf1da5a-de3a-48ba-a364-78f89fb8a66f req-af3277c7-4d7b-4e83-b2b0-9b418642af35 service nova] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing instance network info cache due to event network-changed-5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] Acquiring lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] Acquired lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG nova.network.neutron [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Refreshing network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Port a2df0959-c89f-418d-85b2-1b858d7aca5d binding to destination host user is already ACTIVE {{(pid=74932) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:06 user nova-compute[74932]: INFO nova.compute.manager [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Detaching volume e844b6f6-757a-4036-ae09-8808f0cf1a9d
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:07 user nova-compute[74932]: INFO nova.virt.block_device [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Attempting to driver detach volume e844b6f6-757a-4036-ae09-8808f0cf1a9d from mountpoint /dev/vdb
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquired lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Attempting to detach device vdb from instance 7b1de337-1b43-473b-b929-5e4e357ba9ac from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:46:07 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:46:07 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:46:07 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:46:07 user nova-compute[74932]:   <serial>e844b6f6-757a-4036-ae09-8808f0cf1a9d</serial>
Nov 03 16:46:07 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 16:46:07 user nova-compute[74932]: </disk>
Nov 03 16:46:07 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully detached device vdb from instance 7b1de337-1b43-473b-b929-5e4e357ba9ac from the persistent domain config.
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b1de337-1b43-473b-b929-5e4e357ba9ac from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:46:07 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:46:07 user nova-compute[74932]:   <source dev="/dev/sdd"/>
Nov 03 16:46:07 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:46:07 user nova-compute[74932]:   <serial>e844b6f6-757a-4036-ae09-8808f0cf1a9d</serial>
Nov 03 16:46:07 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 16:46:07 user nova-compute[74932]: </disk>
Nov 03 16:46:07 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updated VIF entry in instance network info cache for port 5c6be14a-8f34-4ec5-8553-fa93ef13051d. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [{"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fc4fc0fe-ee67-4833-9e44-416b62a27d51 req-09df823c-9be3-4094-8b78-c2733e457376 service nova] Releasing lock "refresh_cache-7b1de337-1b43-473b-b929-5e4e357ba9ac" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.network.neutron [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Releasing lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG os_brick.utils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e50c1e-d2d0-49ad-8932-71b619a147b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9c28a-3993-4825-857a-397adfc93249]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[461588d3-7280-410f-97df-96e49dae86d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc5a13-78ae-47d2-9df3-725193ebed11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:46:07 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d1e51-a336-4edc-84b5-d513efa3982b]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG os_brick.utils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:09 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=24.795055389404297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Applying migration context for instance 36b59795-c633-412e-92f4-280e6daeec54 as it has an incoming, in-progress migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81. Migration status is post-migrating {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 16:46:09 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating resource usage from migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 77b76574-4898-49f8-aaee-cff8f7e11b6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 7b1de337-1b43-473b-b929-5e4e357ba9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 2eaa8ccb-1e13-434c-9152-07b866607713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e6e6600c-2878-4318-983a-929b353da7f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 36b59795-c633-412e-92f4-280e6daeec54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77b76574-4898-49f8-aaee-cff8f7e11b6e is timed out.
Nov 03 16:46:11 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully detached device vdb from instance 77b76574-4898-49f8-aaee-cff8f7e11b6e from the live domain config.
Nov 03 16:46:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZjuChxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77934aa-cf57-4c9d-88b8-329559949a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:46:11 user nova-compute[74932]: No targets found.
Nov 03 16:46:11 user nova-compute[74932]: iSNS:
Nov 03 16:46:11 user nova-compute[74932]: No targets found.
Nov 03 16:46:11 user nova-compute[74932]: STATIC:
Nov 03 16:46:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:46:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d
Nov 03 16:46:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced
Nov 03 16:46:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:11 user nova-compute[74932]: FIRMWARE:
Nov 03 16:46:11 user nova-compute[74932]: No targets found.
Nov 03 16:46:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:46:11 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:46:11 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7310555-d49c-4dcb-b263-da453cdd1334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb234f47-1459-4922-9911-86e714dc7d2c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:11 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:46:11 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:11 user nova-compute[74932]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced (non-flash)
Nov 03 16:46:11 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645b35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e1f54e-8918-4512-9e10-a8082ca83aed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7706071-a72b-425c-b245-460f37e40906]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54e628-9284-4ccb-a002-4cf4b230d589]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[89476f08-4675-457c-bf51-cc062248ca33]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[95058dee-5e98-4c3d-b160-01cc815d4949]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd20e0e9-fcb4-4503-a8d1-b6f0a15f6c9d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260]
Nov 03 16:46:11 user nova-compute[74932]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced, portal: 172.16.0.220,3260] successful.
Nov 03 16:46:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a8ab47-5482-4fda-9ea1-074960d43ced -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc765fc-a89a-4d46-9497-9c9ebe1093e8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] <== disconnect_volume: return (327ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:11 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:46:11 user nova-compute[74932]: INFO nova.compute.claims [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Claim successful on node user
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'flavor' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3b6b801e-02f4-408e-a034-3f6831db2d77 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.900s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:46:12 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:46:12 user nova-compute[74932]: DEBUG nova.policy [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2fbcaa1d5bb4249b127dcdc0875517a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f123f628d784aaaadba9dea7eb71ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:46:12 user nova-compute[74932]: INFO nova.virt.block_device [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Booting with volume-backed-image 8156ce23-7acb-4ad0-a7c3-910c755cd964 at /dev/vda
Nov 03 16:46:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Successfully created port: 594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Successfully updated port: 594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-changed-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Refreshing instance network info cache due to event network-changed-594aaaa2-8eca-45bc-942e-6d20701efef9. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] Acquiring lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:13 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updating instance_info_cache with network_info: [{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance network_info: |[{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] Acquired lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Refreshing network info cache for port 594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updated VIF entry in instance network info cache for port 594aaaa2-8eca-45bc-942e-6d20701efef9. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.network.neutron [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updating instance_info_cache with network_info: [{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-5606ca14-0901-44e8-83a6-ff73c1dcc9a3 req-1bb4e030-5bfd-407d-ad11-6deefbbe5238 service nova] Releasing lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:46:14 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Creating image(s)
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Ensure instance console log exists: /opt/stack/data/nova/instances/e6e6600c-2878-4318-983a-929b353da7f7/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Start _get_guest_xml network_info=[{"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSsoDwcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6e6600c-2878-4318-983a-929b353da7f7', 'attached_at': '', 'detached_at': '', 'volume_id': '69b0f62a-8ab6-4e8c-8c38-64c286de2a41', 'serial': '69b0f62a-8ab6-4e8c-8c38-64c286de2a41'}, 'attachment_id': '270e9749-2433-4534-a5b4-95117bd17d65', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:46:14 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:14 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSsoDwcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:14 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:14 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[41949548-af9b-4a69-a3e7-efebf4cb01a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:46:14 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266eca0-4a3e-43b7-9580-7f44585a803d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41] added
Nov 03 16:46:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c1f88-3df6-4c9e-ab34-379a3c3ffb1a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a2f4b-7447-4957-acc5-5b5b2ca69ac7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSsoDwcm {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSsoDwcm" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3200f03-fa5b-4de5-a621-1fd62cf96348]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSsoDwcm'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cf7494-407f-4a3b-b431-6143b0ddc691]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c84c4f6-0c07-45f5-8707-92573626b35e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:14 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:14 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d85fa3-4f9a-4f0c-bc7f-ae7fa9cc63a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260]
Nov 03 16:46:14 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260] successful.
Nov 03 16:46:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[de15fc88-c82e-4f93-a039-a3f3b6bcf20c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748aa76-d1b7-4318-a167-87b21d5f9df4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:14 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:14 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:14 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:14 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:14 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a8a4c-7c4e-4580-9ccb-bc358abb6091]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:46:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSsoDwcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23662316162313233', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662316162313233', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-646749031',display_name='tempest-TestVolumeBootPattern-server-646749031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-646749031',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-qp4fxrk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:45:48Z,user_data=None,user_id='9cd7108d051f4052882dc2855457da38',uuid=e6e6600c-2878-4318-983a-929b353da7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.objects.instance [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'pci_devices' on Instance uuid e6e6600c-2878-4318-983a-929b353da7f7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:46:15 user nova-compute[74932]:   <uuid>e6e6600c-2878-4318-983a-929b353da7f7</uuid>
Nov 03 16:46:15 user nova-compute[74932]:   <name>instance-00000025</name>
Nov 03 16:46:15 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:46:15 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:46:15 user nova-compute[74932]:   <metadata>
Nov 03 16:46:15 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:46:15 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:46:15 user nova-compute[74932]:       <nova:name>tempest-TestVolumeBootPattern-server-646749031</nova:name>
Nov 03 16:46:15 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:46:14</nova:creationTime>
Nov 03 16:46:15 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:46:15 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:46:15 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:46:15 user nova-compute[74932]:       <nova:owner>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:user uuid="9cd7108d051f4052882dc2855457da38">tempest-TestVolumeBootPattern-1760430654-project-member</nova:user>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:project uuid="111f571583f844359234fa4760d45a35">tempest-TestVolumeBootPattern-1760430654</nova:project>
Nov 03 16:46:15 user nova-compute[74932]:       </nova:owner>
Nov 03 16:46:15 user nova-compute[74932]:       <nova:ports>
Nov 03 16:46:15 user nova-compute[74932]:         <nova:port uuid="071c468c-f474-4eea-a67d-0a6a8b79805a">
Nov 03 16:46:15 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 16:46:15 user nova-compute[74932]:         </nova:port>
Nov 03 16:46:15 user nova-compute[74932]:       </nova:ports>
Nov 03 16:46:15 user nova-compute[74932]:     </nova:instance>
Nov 03 16:46:15 user nova-compute[74932]:   </metadata>
Nov 03 16:46:15 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:46:15 user nova-compute[74932]:     <system>
Nov 03 16:46:15 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:46:15 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:46:15 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:46:15 user nova-compute[74932]:       <entry name="serial">e6e6600c-2878-4318-983a-929b353da7f7</entry>
Nov 03 16:46:15 user nova-compute[74932]:       <entry name="uuid">e6e6600c-2878-4318-983a-929b353da7f7</entry>
Nov 03 16:46:15 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:46:15 user nova-compute[74932]:     </system>
Nov 03 16:46:15 user nova-compute[74932]:   </sysinfo>
Nov 03 16:46:15 user nova-compute[74932]:   <os>
Nov 03 16:46:15 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:46:15 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:46:15 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:46:15 user nova-compute[74932]:   </os>
Nov 03 16:46:15 user nova-compute[74932]:   <features>
Nov 03 16:46:15 user nova-compute[74932]:     <acpi/>
Nov 03 16:46:15 user nova-compute[74932]:     <apic/>
Nov 03 16:46:15 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:46:15 user nova-compute[74932]:   </features>
Nov 03 16:46:15 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:46:15 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:46:15 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:46:15 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:46:15 user nova-compute[74932]:   </clock>
Nov 03 16:46:15 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:46:15 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:46:15 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:46:15 user nova-compute[74932]:   </cpu>
Nov 03 16:46:15 user nova-compute[74932]:   <devices>
Nov 03 16:46:15 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:46:15 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:46:15 user nova-compute[74932]:       <source dev="/dev/sdc"/>
Nov 03 16:46:15 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:46:15 user nova-compute[74932]:       <serial>69b0f62a-8ab6-4e8c-8c38-64c286de2a41</serial>
Nov 03 16:46:15 user nova-compute[74932]:     </disk>
Nov 03 16:46:15 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:46:15 user nova-compute[74932]:       <mac address="fa:16:3e:34:55:85"/>
Nov 03 16:46:15 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:46:15 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:46:15 user nova-compute[74932]:       <target dev="tap071c468c-f4"/>
Nov 03 16:46:15 user nova-compute[74932]:     </interface>
Nov 03 16:46:15 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:46:15 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/e6e6600c-2878-4318-983a-929b353da7f7/console.log" append="off"/>
Nov 03 16:46:15 user nova-compute[74932]:     </serial>
Nov 03 16:46:15 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:46:15 user nova-compute[74932]:     <video>
Nov 03 16:46:15 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:46:15 user nova-compute[74932]:     </video>
Nov 03 16:46:15 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:46:15 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:46:15 user nova-compute[74932]:     </rng>
Nov 03 16:46:15 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:46:15 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:46:15 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:46:15 user nova-compute[74932]:     </memballoon>
Nov 03 16:46:15 user nova-compute[74932]:   </devices>
Nov 03 16:46:15 user nova-compute[74932]: </domain>
Nov 03 16:46:15 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-646749031',display_name='tempest-TestVolumeBootPattern-server-646749031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-646749031',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-qp4fxrk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:45:48Z,user_data=None,user_id='9cd7108d051f4052882dc2855457da38',uuid=e6e6600c-2878-4318-983a-929b353da7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG os_vif [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aff048cb-3fde-550e-9adc-4210a37be6a9', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap071c468c-f4, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap071c468c-f4, col_values=(('qos', UUID('61f19190-5307-42de-90f2-ee1645b27e5c')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap071c468c-f4, col_values=(('external_ids', {'iface-id': '071c468c-f474-4eea-a67d-0a6a8b79805a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:55:85', 'vm-uuid': 'e6e6600c-2878-4318-983a-929b353da7f7'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:15 user nova-compute[74932]: INFO os_vif [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4')
Nov 03 16:46:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:46:16 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No VIF found with MAC fa:16:3e:34:55:85, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-74b90c41-81c6-48bf-a54f-055d98848f05 req-38bc492e-c592-4608-a05b-0888feb804d5 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74b90c41-81c6-48bf-a54f-055d98848f05 req-38bc492e-c592-4608-a05b-0888feb804d5 service nova] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74b90c41-81c6-48bf-a54f-055d98848f05 req-38bc492e-c592-4608-a05b-0888feb804d5 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-74b90c41-81c6-48bf-a54f-055d98848f05 req-38bc492e-c592-4608-a05b-0888feb804d5 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-74b90c41-81c6-48bf-a54f-055d98848f05 req-38bc492e-c592-4608-a05b-0888feb804d5 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] No waiting events found dispatching network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:17 user nova-compute[74932]: WARNING nova.compute.manager [req-74b90c41-81c6-48bf-a54f-055d98848f05 req-38bc492e-c592-4608-a05b-0888feb804d5 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received unexpected event network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a for instance with vm_state building and task_state spawning.
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:46:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Instance spawned successfully.
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:19 user nova-compute[74932]: INFO nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-c2d302f1-1bc8-40d5-bf4e-346f8294a50e req-958b84bc-13b8-4127-a48d-999016ec16b0 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c2d302f1-1bc8-40d5-bf4e-346f8294a50e req-958b84bc-13b8-4127-a48d-999016ec16b0 service nova] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c2d302f1-1bc8-40d5-bf4e-346f8294a50e req-958b84bc-13b8-4127-a48d-999016ec16b0 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c2d302f1-1bc8-40d5-bf4e-346f8294a50e req-958b84bc-13b8-4127-a48d-999016ec16b0 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-c2d302f1-1bc8-40d5-bf4e-346f8294a50e req-958b84bc-13b8-4127-a48d-999016ec16b0 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] No waiting events found dispatching network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:19 user nova-compute[74932]: WARNING nova.compute.manager [req-c2d302f1-1bc8-40d5-bf4e-346f8294a50e req-958b84bc-13b8-4127-a48d-999016ec16b0 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received unexpected event network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a for instance with vm_state building and task_state spawning.
Nov 03 16:46:19 user nova-compute[74932]: INFO nova.compute.manager [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Took 31.92 seconds to build instance.
Nov 03 16:46:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-15b642ba-6050-4de4-a08c-c5bdd43a45c6 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e6e6600c-2878-4318-983a-929b353da7f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.013s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:27 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b1de337-1b43-473b-b929-5e4e357ba9ac is timed out.
Nov 03 16:46:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully detached device vdb from instance 7b1de337-1b43-473b-b929-5e4e357ba9ac from the live domain config.
Nov 03 16:46:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqTpWgEC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:27 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c19cd-9d90-46aa-8d57-0094a5654821]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:46:27 user nova-compute[74932]: No targets found.
Nov 03 16:46:27 user nova-compute[74932]: iSNS:
Nov 03 16:46:27 user nova-compute[74932]: No targets found.
Nov 03 16:46:27 user nova-compute[74932]: STATIC:
Nov 03 16:46:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:46:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41
Nov 03 16:46:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:27 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d
Nov 03 16:46:27 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:46:27 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:46:27 user nova-compute[74932]: FIRMWARE:
Nov 03 16:46:27 user nova-compute[74932]: No targets found.
Nov 03 16:46:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:46:27 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:46:27 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ec22b-2c94-446e-9cfa-06e88194537e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae9cd5d-e79b-4bea-80d7-34a064606109]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:27 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:27 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:27 user nova-compute[74932]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d (non-flash)
Nov 03 16:46:27 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc843509d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[424cee68-e8c0-4623-b7de-73c640145778]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e853b-481c-48f0-935e-416ace13a538]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[93174f47-c503-4e96-8d1c-0051f53d93ba]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bbdb17-a477-4830-81f6-77ed71658d3f]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a171b9e5-1fda-47a4-a1db-a6e6b6f4f59e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac33a45-083a-483c-9a05-6f7f63fedaa1]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260]
Nov 03 16:46:27 user nova-compute[74932]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d, portal: 172.16.0.220,3260] successful.
Nov 03 16:46:27 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e844b6f6-757a-4036-ae09-8808f0cf1a9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f4d36-0236-4f07-9d6d-aaa87e7d630b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== disconnect_volume: return (309ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.utils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Starting finish_migration {{(pid=74932) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:46:28 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Creating image(s)
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Ensure instance console log exists: /opt/stack/data/nova/instances/36b59795-c633-412e-92f4-280e6daeec54/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Start _get_guest_xml network_info=[{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '36b59795-c633-412e-92f4-280e6daeec54', 'attached_at': '2023-11-03T16:46:28.000000', 'detached_at': '', 'volume_id': '67345509-4a46-4c21-be0b-50f501f1ede2', 'serial': '67345509-4a46-4c21-be0b-50f501f1ede2'}, 'attachment_id': '6e6dba53-6229-41c5-b682-03d321b0928a', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:28 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a188f-b868-4961-8717-9805ba5f65d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:28 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:28 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:28 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b636802e-d7a9-4726-b759-2447a9d9c310]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9703a0-b276-40de-9e01-db4f3de53205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:46:28 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b6b83-473e-4ca4-8532-282c1e05afb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e4297-4de2-49d9-a6b6-bb19e617643e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e4df3-f121-424e-82f7-c0426132f8a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2] added
Nov 03 16:46:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:46:28 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5271f2-7c0a-491e-bbbd-39e1f8e343d4]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.utils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updating existing volume attachment record: 8e0d53d6-0cc5-4e0e-82a6-b6724eb2f5e0 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c3de7e-7b0d-4052-aecc-a51ae41f1007]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1823007-3ade-4975-bdd3-f4e0200845d9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBtYagPF {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBtYagPF" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abcd38-6ba1-43b5-b160-b6d4bccf69fa]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBtYagPF'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[07071c7d-361c-4cae-aebb-fd0a4f70d63b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31bf56-a273-4a6a-975d-399c0c2e0c82]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b62d65-09fe-4903-a03e-f1b721484e15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]
Nov 03 16:46:28 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.
Nov 03 16:46:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c4bc93-e480-4384-a0d0-41fcde971d4c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8e81ae-4e7b-4f9a-b2f8-dc0498063f71]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:28 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a0193-faab-42c4-a7be-8b6dde2bb99a]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:46:28 user nova-compute[74932]: DEBUG nova.objects.instance [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'flavor' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-2f1772d1-fcb5-4351-9e7a-781f29750d95 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.171s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23837306139346232', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837306139346232', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-681209233',display_name='tempest-ServerActionsTestOtherA-server-681209233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-681209233',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-udx1o824',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=36b59795-c633-412e-92f4-280e6daeec54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:46:29 user nova-compute[74932]:   <uuid>36b59795-c633-412e-92f4-280e6daeec54</uuid>
Nov 03 16:46:29 user nova-compute[74932]:   <name>instance-00000023</name>
Nov 03 16:46:29 user nova-compute[74932]:   <memory>2097152</memory>
Nov 03 16:46:29 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:46:29 user nova-compute[74932]:   <metadata>
Nov 03 16:46:29 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:46:29 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:46:29 user nova-compute[74932]:       <nova:name>tempest-ServerActionsTestOtherA-server-681209233</nova:name>
Nov 03 16:46:29 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:46:28</nova:creationTime>
Nov 03 16:46:29 user nova-compute[74932]:       <nova:flavor name="m1.small">
Nov 03 16:46:29 user nova-compute[74932]:         <nova:memory>2048</nova:memory>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:disk>20</nova:disk>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:46:29 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:46:29 user nova-compute[74932]:       <nova:owner>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:user uuid="90fa01b533204995b57b88b0a4aac138">tempest-ServerActionsTestOtherA-1516695200-project-member</nova:user>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:project uuid="9a8cbb942aff476ebf7cca3968447573">tempest-ServerActionsTestOtherA-1516695200</nova:project>
Nov 03 16:46:29 user nova-compute[74932]:       </nova:owner>
Nov 03 16:46:29 user nova-compute[74932]:       <nova:ports>
Nov 03 16:46:29 user nova-compute[74932]:         <nova:port uuid="a2df0959-c89f-418d-85b2-1b858d7aca5d">
Nov 03 16:46:29 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 16:46:29 user nova-compute[74932]:         </nova:port>
Nov 03 16:46:29 user nova-compute[74932]:       </nova:ports>
Nov 03 16:46:29 user nova-compute[74932]:     </nova:instance>
Nov 03 16:46:29 user nova-compute[74932]:   </metadata>
Nov 03 16:46:29 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:46:29 user nova-compute[74932]:     <system>
Nov 03 16:46:29 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:46:29 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:46:29 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:46:29 user nova-compute[74932]:       <entry name="serial">36b59795-c633-412e-92f4-280e6daeec54</entry>
Nov 03 16:46:29 user nova-compute[74932]:       <entry name="uuid">36b59795-c633-412e-92f4-280e6daeec54</entry>
Nov 03 16:46:29 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:46:29 user nova-compute[74932]:     </system>
Nov 03 16:46:29 user nova-compute[74932]:   </sysinfo>
Nov 03 16:46:29 user nova-compute[74932]:   <os>
Nov 03 16:46:29 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:46:29 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:46:29 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:46:29 user nova-compute[74932]:   </os>
Nov 03 16:46:29 user nova-compute[74932]:   <features>
Nov 03 16:46:29 user nova-compute[74932]:     <acpi/>
Nov 03 16:46:29 user nova-compute[74932]:     <apic/>
Nov 03 16:46:29 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:46:29 user nova-compute[74932]:   </features>
Nov 03 16:46:29 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:46:29 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:46:29 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:46:29 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:46:29 user nova-compute[74932]:   </clock>
Nov 03 16:46:29 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:46:29 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:46:29 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:46:29 user nova-compute[74932]:   </cpu>
Nov 03 16:46:29 user nova-compute[74932]:   <devices>
Nov 03 16:46:29 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:46:29 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:46:29 user nova-compute[74932]:       <source dev="/dev/sdd"/>
Nov 03 16:46:29 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:46:29 user nova-compute[74932]:       <serial>67345509-4a46-4c21-be0b-50f501f1ede2</serial>
Nov 03 16:46:29 user nova-compute[74932]:     </disk>
Nov 03 16:46:29 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:46:29 user nova-compute[74932]:       <mac address="fa:16:3e:cd:fd:a3"/>
Nov 03 16:46:29 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:46:29 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:46:29 user nova-compute[74932]:       <target dev="tapa2df0959-c8"/>
Nov 03 16:46:29 user nova-compute[74932]:     </interface>
Nov 03 16:46:29 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:46:29 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/36b59795-c633-412e-92f4-280e6daeec54/console.log" append="off"/>
Nov 03 16:46:29 user nova-compute[74932]:     </serial>
Nov 03 16:46:29 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:46:29 user nova-compute[74932]:     <video>
Nov 03 16:46:29 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:46:29 user nova-compute[74932]:     </video>
Nov 03 16:46:29 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:46:29 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:46:29 user nova-compute[74932]:     </rng>
Nov 03 16:46:29 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:46:29 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:46:29 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:46:29 user nova-compute[74932]:     </memballoon>
Nov 03 16:46:29 user nova-compute[74932]:   </devices>
Nov 03 16:46:29 user nova-compute[74932]: </domain>
Nov 03 16:46:29 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-681209233',display_name='tempest-ServerActionsTestOtherA-server-681209233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-681209233',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-udx1o824',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=36b59795-c633-412e-92f4-280e6daeec54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1450551504-network", "vif_mac": "fa:16:3e:cd:fd:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG os_vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6041acc-61ff-5a20-85b8-e2d60b5165ad', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2df0959-c8, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2df0959-c8, col_values=(('qos', UUID('330b38e2-bc8d-4e13-b797-433a26979790')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2df0959-c8, col_values=(('external_ids', {'iface-id': 'a2df0959-c89f-418d-85b2-1b858d7aca5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:fd:a3', 'vm-uuid': '36b59795-c633-412e-92f4-280e6daeec54'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:29 user nova-compute[74932]: INFO os_vif [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8')
Nov 03 16:46:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:46:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] No VIF found with MAC fa:16:3e:cd:fd:a3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG nova.compute.manager [req-e5e381ba-0393-4c54-a8e7-995e96a42885 req-1a8aa5e2-1609-445d-8518-51cbe029c640 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e5e381ba-0393-4c54-a8e7-995e96a42885 req-1a8aa5e2-1609-445d-8518-51cbe029c640 service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e5e381ba-0393-4c54-a8e7-995e96a42885 req-1a8aa5e2-1609-445d-8518-51cbe029c640 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e5e381ba-0393-4c54-a8e7-995e96a42885 req-1a8aa5e2-1609-445d-8518-51cbe029c640 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:31 user nova-compute[74932]: DEBUG nova.compute.manager [req-e5e381ba-0393-4c54-a8e7-995e96a42885 req-1a8aa5e2-1609-445d-8518-51cbe029c640 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:31 user nova-compute[74932]: WARNING nova.compute.manager [req-e5e381ba-0393-4c54-a8e7-995e96a42885 req-1a8aa5e2-1609-445d-8518-51cbe029c640 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state active and task_state resize_finish.
Nov 03 16:46:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:33 user nova-compute[74932]: DEBUG nova.compute.manager [req-167ed437-a96e-4eae-ba54-bdc7bcdef14f req-68e7aed6-8fe3-44c8-8222-586e80b83951 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-167ed437-a96e-4eae-ba54-bdc7bcdef14f req-68e7aed6-8fe3-44c8-8222-586e80b83951 service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-167ed437-a96e-4eae-ba54-bdc7bcdef14f req-68e7aed6-8fe3-44c8-8222-586e80b83951 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-167ed437-a96e-4eae-ba54-bdc7bcdef14f req-68e7aed6-8fe3-44c8-8222-586e80b83951 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:33 user nova-compute[74932]: DEBUG nova.compute.manager [req-167ed437-a96e-4eae-ba54-bdc7bcdef14f req-68e7aed6-8fe3-44c8-8222-586e80b83951 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:33 user nova-compute[74932]: WARNING nova.compute.manager [req-167ed437-a96e-4eae-ba54-bdc7bcdef14f req-68e7aed6-8fe3-44c8-8222-586e80b83951 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state active and task_state resize_finish.
Nov 03 16:46:33 user nova-compute[74932]: DEBUG nova.compute.manager [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:46:34 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance running successfully.
Nov 03 16:46:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Failed to set time: agent not configured {{(pid=74932) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 03 16:46:34 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-2770c3ee-b8a7-4ebe-9f76-50f8ecfdb201 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] finish_migration finished successfully. {{(pid=74932) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 03 16:46:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:40 user nova-compute[74932]: INFO nova.compute.manager [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Terminating instance
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-1d422123-eacb-4709-b14a-8467f853f515 req-b29bdb55-da0c-4625-b5b7-c0d93c22e409 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1d422123-eacb-4709-b14a-8467f853f515 req-b29bdb55-da0c-4625-b5b7-c0d93c22e409 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1d422123-eacb-4709-b14a-8467f853f515 req-b29bdb55-da0c-4625-b5b7-c0d93c22e409 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1d422123-eacb-4709-b14a-8467f853f515 req-b29bdb55-da0c-4625-b5b7-c0d93c22e409 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-1d422123-eacb-4709-b14a-8467f853f515 req-b29bdb55-da0c-4625-b5b7-c0d93c22e409 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-1d422123-eacb-4709-b14a-8467f853f515 req-b29bdb55-da0c-4625-b5b7-c0d93c22e409 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-unplugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Instance destroyed successfully.
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'resources' on Instance uuid 77b76574-4898-49f8-aaee-cff8f7e11b6e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-172897330',display_name='tempest-ServerRescueNegativeTestJSON-server-172897330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-172897330',id=32,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwyl71SkI69ufpiaDKKLYxWe0GV/IiYZYNRQC1KWGqgNr1y0Ycm5ZB3Z4cgBiUc128vQsYz17MojxO3lADHJNNYkd6mvQ5eRIIaDYD08kkSfOxaUH6iCopGtZrxkBf0XQ==',key_name='tempest-keypair-425901354',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-33le1rv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=77b76574-4898-49f8-aaee-cff8f7e11b6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "address": "fa:16:3e:c4:0a:af", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e54265e-4e", "ovs_interfaceid": "3e54265e-4ed1-4af7-85d6-033ddbae3b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG os_vif [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e54265e-4e, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bedf8210-283c-4565-8a9e-e1b60f89bc1e) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:41 user nova-compute[74932]: INFO os_vif [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:0a:af,bridge_name='br-int',has_traffic_filtering=True,id=3e54265e-4ed1-4af7-85d6-033ddbae3b7b,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e54265e-4e')
Nov 03 16:46:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Deleting instance files /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e_del
Nov 03 16:46:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Deletion of /opt/stack/data/nova/instances/77b76574-4898-49f8-aaee-cff8f7e11b6e_del complete
Nov 03 16:46:41 user nova-compute[74932]: INFO nova.compute.manager [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 16:46:41 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:46:41 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:46:42 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:42 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Took 0.90 seconds to deallocate network for instance.
Nov 03 16:46:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] Acquiring lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] No waiting events found dispatching network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:43 user nova-compute[74932]: WARNING nova.compute.manager [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received unexpected event network-vif-plugged-3e54265e-4ed1-4af7-85d6-033ddbae3b7b for instance with vm_state deleted and task_state None.
Nov 03 16:46:43 user nova-compute[74932]: DEBUG nova.compute.manager [req-54d390f9-dcc6-4d2d-a643-1b67851d120e req-874cd767-9365-45df-90bc-f6d985731684 service nova] [instance: 77b76574-4898-49f8-aaee-cff8f7e11b6e] Received event network-vif-deleted-3e54265e-4ed1-4af7-85d6-033ddbae3b7b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:43 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Deleted allocations for instance 77b76574-4898-49f8-aaee-cff8f7e11b6e
Nov 03 16:46:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ab136b9b-b9b4-4e1e-aec4-cbb268f68dbf tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "77b76574-4898-49f8-aaee-cff8f7e11b6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:46:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Creating image(s)
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Ensure instance console log exists: /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Start _get_guest_xml network_info=[{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f92a2cae-8a28-47b6-965f-17d8e7952287', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'serial': 'b9582e02-80c5-48d0-9e82-07019f1ecf0b'}, 'attachment_id': '8e0d53d6-0cc5-4e0e-82a6-b6724eb2f5e0', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:46:50 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:50 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:46:50 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:50 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:46:50 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16b5a7f-4e07-442e-884c-2c5f9351b58c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:46:50 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5b8af-b39a-487e-8297-87cc00a60b78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b] added
Nov 03 16:46:50 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ee500-6b7d-4ae1-ab64-30e65130a522]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c67c7-f3f7-47ef-b86d-d8707bd5865a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIHOqNCz {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIHOqNCz" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b2f03c-3b71-45aa-9bb9-da911a0d5fb2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIHOqNCz'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19754a8-f4bc-4f03-9918-b3ca2629c1f9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f72d3b-03a7-4345-aaf0-cc5597dbd17b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac391b6-3069-44c5-aafe-c18b783efd26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260]
Nov 03 16:46:50 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260] successful.
Nov 03 16:46:50 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8497f1-1945-43e4-b772-1928b1584549]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[770905e4-77bf-4f22-bf27-7a1e1bad634e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:46:50 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:46:50 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:46:50 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e421d123-fef8-4094-b7ef-77be43d82737]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:46:50 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26366303863393735', 'path': '/dev/sde'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366303863393735', 'path': '/dev/sde'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261612924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261612924',id=38,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-f1vwdf0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:46:12Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=f92a2cae-8a28-47b6-965f-17d8e7952287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'pci_devices' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:46:51 user nova-compute[74932]:   <uuid>f92a2cae-8a28-47b6-965f-17d8e7952287</uuid>
Nov 03 16:46:51 user nova-compute[74932]:   <name>instance-00000026</name>
Nov 03 16:46:51 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:46:51 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:46:51 user nova-compute[74932]:   <metadata>
Nov 03 16:46:51 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:46:51 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:46:51 user nova-compute[74932]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-261612924</nova:name>
Nov 03 16:46:51 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:46:50</nova:creationTime>
Nov 03 16:46:51 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:46:51 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:46:51 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:46:51 user nova-compute[74932]:       <nova:owner>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:user uuid="f2fbcaa1d5bb4249b127dcdc0875517a">tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member</nova:user>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:project uuid="5f123f628d784aaaadba9dea7eb71ce2">tempest-ServerBootFromVolumeStableRescueTest-2083155834</nova:project>
Nov 03 16:46:51 user nova-compute[74932]:       </nova:owner>
Nov 03 16:46:51 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:46:51 user nova-compute[74932]:       <nova:ports>
Nov 03 16:46:51 user nova-compute[74932]:         <nova:port uuid="594aaaa2-8eca-45bc-942e-6d20701efef9">
Nov 03 16:46:51 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 16:46:51 user nova-compute[74932]:         </nova:port>
Nov 03 16:46:51 user nova-compute[74932]:       </nova:ports>
Nov 03 16:46:51 user nova-compute[74932]:     </nova:instance>
Nov 03 16:46:51 user nova-compute[74932]:   </metadata>
Nov 03 16:46:51 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:46:51 user nova-compute[74932]:     <system>
Nov 03 16:46:51 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:46:51 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:46:51 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:46:51 user nova-compute[74932]:       <entry name="serial">f92a2cae-8a28-47b6-965f-17d8e7952287</entry>
Nov 03 16:46:51 user nova-compute[74932]:       <entry name="uuid">f92a2cae-8a28-47b6-965f-17d8e7952287</entry>
Nov 03 16:46:51 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:46:51 user nova-compute[74932]:     </system>
Nov 03 16:46:51 user nova-compute[74932]:   </sysinfo>
Nov 03 16:46:51 user nova-compute[74932]:   <os>
Nov 03 16:46:51 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:46:51 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:46:51 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:46:51 user nova-compute[74932]:   </os>
Nov 03 16:46:51 user nova-compute[74932]:   <features>
Nov 03 16:46:51 user nova-compute[74932]:     <acpi/>
Nov 03 16:46:51 user nova-compute[74932]:     <apic/>
Nov 03 16:46:51 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:46:51 user nova-compute[74932]:   </features>
Nov 03 16:46:51 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:46:51 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:46:51 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:46:51 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:46:51 user nova-compute[74932]:   </clock>
Nov 03 16:46:51 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:46:51 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:46:51 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:46:51 user nova-compute[74932]:   </cpu>
Nov 03 16:46:51 user nova-compute[74932]:   <devices>
Nov 03 16:46:51 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:46:51 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:46:51 user nova-compute[74932]:       <source dev="/dev/sde"/>
Nov 03 16:46:51 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:46:51 user nova-compute[74932]:       <serial>b9582e02-80c5-48d0-9e82-07019f1ecf0b</serial>
Nov 03 16:46:51 user nova-compute[74932]:     </disk>
Nov 03 16:46:51 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:46:51 user nova-compute[74932]:       <mac address="fa:16:3e:fd:82:34"/>
Nov 03 16:46:51 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:46:51 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:46:51 user nova-compute[74932]:       <target dev="tap594aaaa2-8e"/>
Nov 03 16:46:51 user nova-compute[74932]:     </interface>
Nov 03 16:46:51 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:46:51 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/console.log" append="off"/>
Nov 03 16:46:51 user nova-compute[74932]:     </serial>
Nov 03 16:46:51 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:46:51 user nova-compute[74932]:     <video>
Nov 03 16:46:51 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:46:51 user nova-compute[74932]:     </video>
Nov 03 16:46:51 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:46:51 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:46:51 user nova-compute[74932]:     </rng>
Nov 03 16:46:51 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:46:51 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:46:51 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:46:51 user nova-compute[74932]:     </memballoon>
Nov 03 16:46:51 user nova-compute[74932]:   </devices>
Nov 03 16:46:51 user nova-compute[74932]: </domain>
Nov 03 16:46:51 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261612924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261612924',id=38,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-f1vwdf0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:46:12Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=f92a2cae-8a28-47b6-965f-17d8e7952287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG os_vif [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2ca8ca8-be26-5e66-af58-3cd838d07ac4', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap594aaaa2-8e, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap594aaaa2-8e, col_values=(('qos', UUID('dfe03194-84ba-496c-84a3-7379f9079549')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap594aaaa2-8e, col_values=(('external_ids', {'iface-id': '594aaaa2-8eca-45bc-942e-6d20701efef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:82:34', 'vm-uuid': 'f92a2cae-8a28-47b6-965f-17d8e7952287'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:51 user nova-compute[74932]: INFO os_vif [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e')
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:46:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No VIF found with MAC fa:16:3e:fd:82:34, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-3cb649f6-3d0b-4266-98dc-7b9f5cb0f67e req-f6fdd307-89c8-446f-8cdf-11ec66e0fa99 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3cb649f6-3d0b-4266-98dc-7b9f5cb0f67e req-f6fdd307-89c8-446f-8cdf-11ec66e0fa99 service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3cb649f6-3d0b-4266-98dc-7b9f5cb0f67e req-f6fdd307-89c8-446f-8cdf-11ec66e0fa99 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3cb649f6-3d0b-4266-98dc-7b9f5cb0f67e req-f6fdd307-89c8-446f-8cdf-11ec66e0fa99 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-3cb649f6-3d0b-4266-98dc-7b9f5cb0f67e req-f6fdd307-89c8-446f-8cdf-11ec66e0fa99 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:52 user nova-compute[74932]: WARNING nova.compute.manager [req-3cb649f6-3d0b-4266-98dc-7b9f5cb0f67e req-f6fdd307-89c8-446f-8cdf-11ec66e0fa99 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state building and task_state spawning.
Nov 03 16:46:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:46:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance spawned successfully.
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b3aba35-0e24-4486-9987-1282219c13c6 req-0ea84993-f4e1-4008-b43c-7fcc727e77b3 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b3aba35-0e24-4486-9987-1282219c13c6 req-0ea84993-f4e1-4008-b43c-7fcc727e77b3 service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b3aba35-0e24-4486-9987-1282219c13c6 req-0ea84993-f4e1-4008-b43c-7fcc727e77b3 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b3aba35-0e24-4486-9987-1282219c13c6 req-0ea84993-f4e1-4008-b43c-7fcc727e77b3 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b3aba35-0e24-4486-9987-1282219c13c6 req-0ea84993-f4e1-4008-b43c-7fcc727e77b3 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:46:54 user nova-compute[74932]: WARNING nova.compute.manager [req-8b3aba35-0e24-4486-9987-1282219c13c6 req-0ea84993-f4e1-4008-b43c-7fcc727e77b3 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state building and task_state spawning.
Nov 03 16:46:54 user nova-compute[74932]: INFO nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 03 16:46:54 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:46:55 user nova-compute[74932]: INFO nova.compute.manager [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Took 43.32 seconds to build instance.
Nov 03 16:46:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f4611dc4-b8c0-4d8b-877d-74e5217ccf6c tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.414s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:46:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:46:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:46:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:46:56 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:46:57 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [{"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:46:57 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-0d0016ac-ccd0-45b7-936b-ff0da827760b" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:46:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:46:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:57 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:46:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:46:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:46:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:04 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:47:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:47:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:08 user nova-compute[74932]: INFO nova.compute.manager [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Terminating instance
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-dc673be6-70b4-4662-a1f2-ba709c14911e req-b90d93a6-d798-4914-8613-cd53cb2a7e90 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-unplugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-dc673be6-70b4-4662-a1f2-ba709c14911e req-b90d93a6-d798-4914-8613-cd53cb2a7e90 service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-dc673be6-70b4-4662-a1f2-ba709c14911e req-b90d93a6-d798-4914-8613-cd53cb2a7e90 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-dc673be6-70b4-4662-a1f2-ba709c14911e req-b90d93a6-d798-4914-8613-cd53cb2a7e90 service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-dc673be6-70b4-4662-a1f2-ba709c14911e req-b90d93a6-d798-4914-8613-cd53cb2a7e90 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-unplugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-dc673be6-70b4-4662-a1f2-ba709c14911e req-b90d93a6-d798-4914-8613-cd53cb2a7e90 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-unplugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Instance destroyed successfully.
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'resources' on Instance uuid 7b1de337-1b43-473b-b929-5e4e357ba9ac {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1329843655',display_name='tempest-TestMinimumBasicScenario-server-1329843655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1329843655',id=33,image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzIHQexU1m2W5QsFqd6Q7i8UiToJ5TQ321aeCEjlM8ySKJmAhlSMxg+P5IPxaD/sjXVZ5imyXrq7ejkhMBybtHu0n/rHm4RtCp6vX6nd8EGOCOBwj1JTjuQ6cQRJjOEtQ==',key_name='tempest-TestMinimumBasicScenario-928640101',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-psdcoxqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35e93787-0a72-4388-8e41-a72dba694e9e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:44:21Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=7b1de337-1b43-473b-b929-5e4e357ba9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "address": "fa:16:3e:b6:9b:05", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6be14a-8f", "ovs_interfaceid": "5c6be14a-8f34-4ec5-8553-fa93ef13051d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG os_vif [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c6be14a-8f, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d21745b2-f90a-42c9-af87-a74059d5fcec) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:08 user nova-compute[74932]: INFO os_vif [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9b:05,bridge_name='br-int',has_traffic_filtering=True,id=5c6be14a-8f34-4ec5-8553-fa93ef13051d,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6be14a-8f')
Nov 03 16:47:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Deleting instance files /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac_del
Nov 03 16:47:08 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Deletion of /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac_del complete
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json" returned: 1 in 0.208s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk --force-share --output=json' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:47:08 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000021, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/7b1de337-1b43-473b-b929-5e4e357ba9ac/disk
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:08 user nova-compute[74932]: INFO nova.compute.manager [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 03 16:47:08 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:47:08 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-4e73c6eb-2bcb-416b-bf4f-0570b4e4567c req-ca83eee5-b5e7-46fe-ac5c-6cd545f47b62 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-deleted-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:09 user nova-compute[74932]: INFO nova.compute.manager [req-4e73c6eb-2bcb-416b-bf4f-0570b4e4567c req-ca83eee5-b5e7-46fe-ac5c-6cd545f47b62 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Neutron deleted interface 5c6be14a-8f34-4ec5-8553-fa93ef13051d; detaching it from the instance and deleting it from the info cache
Nov 03 16:47:09 user nova-compute[74932]: DEBUG nova.network.neutron [req-4e73c6eb-2bcb-416b-bf4f-0570b4e4567c req-ca83eee5-b5e7-46fe-ac5c-6cd545f47b62 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:09 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Took 0.47 seconds to deallocate network for instance.
Nov 03 16:47:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-4e73c6eb-2bcb-416b-bf4f-0570b4e4567c req-ca83eee5-b5e7-46fe-ac5c-6cd545f47b62 service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Detach interface failed, port_id=5c6be14a-8f34-4ec5-8553-fa93ef13051d, reason: Instance 7b1de337-1b43-473b-b929-5e4e357ba9ac could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:47:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:10 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Deleted allocations for instance 7b1de337-1b43-473b-b929-5e4e357ba9ac
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-2f93d2cb-183e-4a97-873e-3eca2156e9d2 req-7b5bdb06-0539-4374-a778-07f85337eafb service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2f93d2cb-183e-4a97-873e-3eca2156e9d2 req-7b5bdb06-0539-4374-a778-07f85337eafb service nova] Acquiring lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2f93d2cb-183e-4a97-873e-3eca2156e9d2 req-7b5bdb06-0539-4374-a778-07f85337eafb service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2f93d2cb-183e-4a97-873e-3eca2156e9d2 req-7b5bdb06-0539-4374-a778-07f85337eafb service nova] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.manager [req-2f93d2cb-183e-4a97-873e-3eca2156e9d2 req-7b5bdb06-0539-4374-a778-07f85337eafb service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] No waiting events found dispatching network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:10 user nova-compute[74932]: WARNING nova.compute.manager [req-2f93d2cb-183e-4a97-873e-3eca2156e9d2 req-7b5bdb06-0539-4374-a778-07f85337eafb service nova] [instance: 7b1de337-1b43-473b-b929-5e4e357ba9ac] Received unexpected event network-vif-plugged-5c6be14a-8f34-4ec5-8553-fa93ef13051d for instance with vm_state deleted and task_state None.
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a6e106c1-9b87-4ecd-803b-0ca6e59acf20 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "7b1de337-1b43-473b-b929-5e4e357ba9ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:10 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:47:10 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=7599MB free_disk=24.81728744506836GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Applying migration context for instance 36b59795-c633-412e-92f4-280e6daeec54 as it has an incoming, in-progress migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81. Migration status is finished {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 16:47:10 user nova-compute[74932]: INFO nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating resource usage from migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 16bb1633-adf9-4889-a809-3e4eac1071b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 2eaa8ccb-1e13-434c-9152-07b866607713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e6e6600c-2878-4318-983a-929b353da7f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 36b59795-c633-412e-92f4-280e6daeec54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f92a2cae-8a28-47b6-965f-17d8e7952287 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:47:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "2eaa8ccb-1e13-434c-9152-07b866607713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:29 user nova-compute[74932]: INFO nova.compute.manager [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Terminating instance
Nov 03 16:47:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:29 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-bef4a19f-9a20-4cce-80df-48e1b74dfcf8 req-0824037a-a139-4b27-bce2-d099f1db1ca6 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-vif-unplugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bef4a19f-9a20-4cce-80df-48e1b74dfcf8 req-0824037a-a139-4b27-bce2-d099f1db1ca6 service nova] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bef4a19f-9a20-4cce-80df-48e1b74dfcf8 req-0824037a-a139-4b27-bce2-d099f1db1ca6 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bef4a19f-9a20-4cce-80df-48e1b74dfcf8 req-0824037a-a139-4b27-bce2-d099f1db1ca6 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-bef4a19f-9a20-4cce-80df-48e1b74dfcf8 req-0824037a-a139-4b27-bce2-d099f1db1ca6 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] No waiting events found dispatching network-vif-unplugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-bef4a19f-9a20-4cce-80df-48e1b74dfcf8 req-0824037a-a139-4b27-bce2-d099f1db1ca6 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-vif-unplugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:47:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Instance destroyed successfully.
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.objects.instance [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lazy-loading 'resources' on Instance uuid 2eaa8ccb-1e13-434c-9152-07b866607713 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1017097998',display_name='tempest-VolumesNegativeTest-instance-1017097998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1017097998',id=36,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7da40a37a92e429d93abd5f05a514837',ramdisk_id='',reservation_id='r-a2rux8jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-948565881',owner_user_name='tempest-VolumesNegativeTest-948565881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:45:46Z,user_data=None,user_id='60afe1b4e23040fa826b96680e727540',uuid=2eaa8ccb-1e13-434c-9152-07b866607713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Converting VIF {"id": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "address": "fa:16:3e:3b:f6:ed", "network": {"id": "5ab1a0ac-7988-4122-9f27-32633389b35c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "963b05cb9b5441c6ac0a6ce413636c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba408bbf-90", "ovs_interfaceid": "ba408bbf-90a4-4885-a4ab-2342d5e332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG os_vif [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba408bbf-90, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef058654-4aa4-4e6b-9b7b-bd7259734e82) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:30 user nova-compute[74932]: INFO os_vif [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:ed,bridge_name='br-int',has_traffic_filtering=True,id=ba408bbf-90a4-4885-a4ab-2342d5e332d2,network=Network(5ab1a0ac-7988-4122-9f27-32633389b35c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba408bbf-90')
Nov 03 16:47:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Deleting instance files /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713_del
Nov 03 16:47:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Deletion of /opt/stack/data/nova/instances/2eaa8ccb-1e13-434c-9152-07b866607713_del complete
Nov 03 16:47:30 user nova-compute[74932]: INFO nova.compute.manager [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 03 16:47:30 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:30 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Took 0.42 seconds to deallocate network for instance.
Nov 03 16:47:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:31 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:47:31 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:47:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:31 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Deleted allocations for instance 2eaa8ccb-1e13-434c-9152-07b866607713
Nov 03 16:47:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-56d07303-031a-43c5-9e7a-f1e9aa7fdbd6 tempest-VolumesNegativeTest-948565881 tempest-VolumesNegativeTest-948565881-project-member] Lock "2eaa8ccb-1e13-434c-9152-07b866607713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] Acquiring lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] Lock "2eaa8ccb-1e13-434c-9152-07b866607713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] No waiting events found dispatching network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:32 user nova-compute[74932]: WARNING nova.compute.manager [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received unexpected event network-vif-plugged-ba408bbf-90a4-4885-a4ab-2342d5e332d2 for instance with vm_state deleted and task_state None.
Nov 03 16:47:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf40c53f-bc3a-4255-8fc1-aa6d2e2ab0f1 req-fe677fc4-d59a-4835-8339-267edd29dc19 service nova] [instance: 2eaa8ccb-1e13-434c-9152-07b866607713] Received event network-vif-deleted-ba408bbf-90a4-4885-a4ab-2342d5e332d2 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e6e6600c-2878-4318-983a-929b353da7f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:38 user nova-compute[74932]: INFO nova.compute.manager [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Terminating instance
Nov 03 16:47:38 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-60a2df5e-ac05-44bc-8b92-5f0b392bc5e7 req-0ff9d0cd-04a6-44de-8c22-16ab6fac4406 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-vif-unplugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-60a2df5e-ac05-44bc-8b92-5f0b392bc5e7 req-0ff9d0cd-04a6-44de-8c22-16ab6fac4406 service nova] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-60a2df5e-ac05-44bc-8b92-5f0b392bc5e7 req-0ff9d0cd-04a6-44de-8c22-16ab6fac4406 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-60a2df5e-ac05-44bc-8b92-5f0b392bc5e7 req-0ff9d0cd-04a6-44de-8c22-16ab6fac4406 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-60a2df5e-ac05-44bc-8b92-5f0b392bc5e7 req-0ff9d0cd-04a6-44de-8c22-16ab6fac4406 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] No waiting events found dispatching network-vif-unplugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:38 user nova-compute[74932]: DEBUG nova.compute.manager [req-60a2df5e-ac05-44bc-8b92-5f0b392bc5e7 req-0ff9d0cd-04a6-44de-8c22-16ab6fac4406 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-vif-unplugged-071c468c-f474-4eea-a67d-0a6a8b79805a for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Instance destroyed successfully.
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.objects.instance [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'resources' on Instance uuid e6e6600c-2878-4318-983a-929b353da7f7 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-646749031',display_name='tempest-TestVolumeBootPattern-server-646749031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-646749031',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-qp4fxrk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:46:20Z,user_data=None,user_id='9cd7108d051f4052882dc2855457da38',uuid=e6e6600c-2878-4318-983a-929b353da7f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "071c468c-f474-4eea-a67d-0a6a8b79805a", "address": "fa:16:3e:34:55:85", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071c468c-f4", "ovs_interfaceid": "071c468c-f474-4eea-a67d-0a6a8b79805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_vif [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap071c468c-f4, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61f19190-5307-42de-90f2-ee1645b27e5c) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:47:39 user nova-compute[74932]: INFO os_vif [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:55:85,bridge_name='br-int',has_traffic_filtering=True,id=071c468c-f474-4eea-a67d-0a6a8b79805a,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071c468c-f4')
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSsoDwcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:47:39 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22832f4-878f-467e-963e-4144fafa0ba0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:47:39 user nova-compute[74932]: No targets found.
Nov 03 16:47:39 user nova-compute[74932]: iSNS:
Nov 03 16:47:39 user nova-compute[74932]: No targets found.
Nov 03 16:47:39 user nova-compute[74932]: STATIC:
Nov 03 16:47:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:47:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:47:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:47:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2
Nov 03 16:47:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:47:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:47:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b
Nov 03 16:47:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:47:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:47:39 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41
Nov 03 16:47:39 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:47:39 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:47:39 user nova-compute[74932]: FIRMWARE:
Nov 03 16:47:39 user nova-compute[74932]: No targets found.
Nov 03 16:47:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:47:39 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:47:39 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b4eff-1b7e-413d-a779-cc8e3cce982e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75f5e8-be81-4a06-94f1-85bef29ee49f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:47:39 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:47:39 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:47:39 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:47:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:47:39 user nova-compute[74932]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 (non-flash)
Nov 03 16:47:39 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:47:39 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:47:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6432ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b265b3-1146-4a78-82cb-efb187fea824]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb3e8a2-3721-4731-936a-dea6568af8fd]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed7eae-2c4b-4ecf-a37f-e9e67b6e51bc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd9ad7f-f352-40b1-a7c4-8bb52c6f361b]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be5fa18-94a3-4e05-a28b-1ce3bd1b639e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[607636ec-aeac-47d9-b609-d76839d9d17d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260]
Nov 03 16:47:39 user nova-compute[74932]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41, portal: 172.16.0.220,3260] successful.
Nov 03 16:47:39 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b0f62a-8ab6-4e8c-8c38-64c286de2a41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a646d6-2379-4ca0-adae-fffe2fe1224d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== disconnect_volume: return (372ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:47:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Deleting instance files /opt/stack/data/nova/instances/e6e6600c-2878-4318-983a-929b353da7f7_del
Nov 03 16:47:39 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Deletion of /opt/stack/data/nova/instances/e6e6600c-2878-4318-983a-929b353da7f7_del complete
Nov 03 16:47:39 user nova-compute[74932]: INFO nova.compute.manager [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 03 16:47:39 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:47:39 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e6e6600c-2878-4318-983a-929b353da7f7] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:40 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Took 0.69 seconds to deallocate network for instance.
Nov 03 16:47:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-31d7a814-0cea-45a1-ae1a-f646808dbb7f req-09860e2d-0542-4f87-a1e3-bc5361820816 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-vif-deleted-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:40 user nova-compute[74932]: INFO nova.compute.manager [req-31d7a814-0cea-45a1-ae1a-f646808dbb7f req-09860e2d-0542-4f87-a1e3-bc5361820816 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Neutron deleted interface 071c468c-f474-4eea-a67d-0a6a8b79805a; detaching it from the instance and deleting it from the info cache
Nov 03 16:47:40 user nova-compute[74932]: DEBUG nova.network.neutron [req-31d7a814-0cea-45a1-ae1a-f646808dbb7f req-09860e2d-0542-4f87-a1e3-bc5361820816 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-31d7a814-0cea-45a1-ae1a-f646808dbb7f req-09860e2d-0542-4f87-a1e3-bc5361820816 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Detach interface failed, port_id=071c468c-f474-4eea-a67d-0a6a8b79805a, reason: Instance e6e6600c-2878-4318-983a-929b353da7f7 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-c41bf71d-9430-43bc-9921-764fb2f51a16 req-c834969a-aedd-45fd-827c-3524721dd0f0 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received event network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c41bf71d-9430-43bc-9921-764fb2f51a16 req-c834969a-aedd-45fd-827c-3524721dd0f0 service nova] Acquiring lock "e6e6600c-2878-4318-983a-929b353da7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c41bf71d-9430-43bc-9921-764fb2f51a16 req-c834969a-aedd-45fd-827c-3524721dd0f0 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c41bf71d-9430-43bc-9921-764fb2f51a16 req-c834969a-aedd-45fd-827c-3524721dd0f0 service nova] Lock "e6e6600c-2878-4318-983a-929b353da7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:40 user nova-compute[74932]: DEBUG nova.compute.manager [req-c41bf71d-9430-43bc-9921-764fb2f51a16 req-c834969a-aedd-45fd-827c-3524721dd0f0 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] No waiting events found dispatching network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:40 user nova-compute[74932]: WARNING nova.compute.manager [req-c41bf71d-9430-43bc-9921-764fb2f51a16 req-c834969a-aedd-45fd-827c-3524721dd0f0 service nova] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Received unexpected event network-vif-plugged-071c468c-f474-4eea-a67d-0a6a8b79805a for instance with vm_state active and task_state deleting.
Nov 03 16:47:41 user nova-compute[74932]: INFO nova.compute.manager [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Took 0.83 seconds to detach 1 volumes for instance.
Nov 03 16:47:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e6e6600c-2878-4318-983a-929b353da7f7] Deleting volume: 69b0f62a-8ab6-4e8c-8c38-64c286de2a41 {{(pid=74932) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 16:47:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:41 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:47:41 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:47:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:41 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Deleted allocations for instance e6e6600c-2878-4318-983a-929b353da7f7
Nov 03 16:47:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-ed5d1b8b-bd54-4cd5-9394-17f4f2920e4d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e6e6600c-2878-4318-983a-929b353da7f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.349s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Going to confirm migration 2 {{(pid=74932) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquired lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'info_cache' on Instance uuid 36b59795-c633-412e-92f4-280e6daeec54 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [{"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Releasing lock "refresh_cache-36b59795-c633-412e-92f4-280e6daeec54" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'migration_context' on Instance uuid 36b59795-c633-412e-92f4-280e6daeec54 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.objects.base [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Object Instance<36b59795-c633-412e-92f4-280e6daeec54> lazy-loaded attributes: info_cache,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:47:53 user nova-compute[74932]: INFO nova.compute.manager [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Terminating instance
Nov 03 16:47:53 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:47:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.410s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Deleted allocation for migration 31b1c4eb-5481-4df0-a432-1f7ea0327a81
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-3bac1582-dba7-4997-a60f-1bea323f0c4c req-eb147554-f6db-4b71-bad4-70a45626c2df service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-unplugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3bac1582-dba7-4997-a60f-1bea323f0c4c req-eb147554-f6db-4b71-bad4-70a45626c2df service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3bac1582-dba7-4997-a60f-1bea323f0c4c req-eb147554-f6db-4b71-bad4-70a45626c2df service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-3bac1582-dba7-4997-a60f-1bea323f0c4c req-eb147554-f6db-4b71-bad4-70a45626c2df service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-3bac1582-dba7-4997-a60f-1bea323f0c4c req-eb147554-f6db-4b71-bad4-70a45626c2df service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-unplugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-3bac1582-dba7-4997-a60f-1bea323f0c4c req-eb147554-f6db-4b71-bad4-70a45626c2df service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-unplugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7f0ece2e-aaba-41fe-80c0-be656b228df1 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.637s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Instance destroyed successfully.
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'resources' on Instance uuid 16bb1633-adf9-4889-a809-3e4eac1071b9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-989134293',display_name='tempest-ServerRescueNegativeTestJSON-server-989134293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-989134293',id=19,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-lji0h7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:32:55Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=16bb1633-adf9-4889-a809-3e4eac1071b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "address": "fa:16:3e:23:89:6c", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e55e6c0-b9", "ovs_interfaceid": "6e55e6c0-b9a2-46a5-864b-fad6269714ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG os_vif [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e55e6c0-b9, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f859ef47-01fc-4569-9baa-5022533703ea) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:47:54 user nova-compute[74932]: INFO os_vif [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:89:6c,bridge_name='br-int',has_traffic_filtering=True,id=6e55e6c0-b9a2-46a5-864b-fad6269714ea,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e55e6c0-b9')
Nov 03 16:47:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Deleting instance files /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9_del
Nov 03 16:47:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Deletion of /opt/stack/data/nova/instances/16bb1633-adf9-4889-a809-3e4eac1071b9_del complete
Nov 03 16:47:54 user nova-compute[74932]: INFO nova.compute.manager [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 16:47:54 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:47:54 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:47:55 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:55 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Took 0.48 seconds to deallocate network for instance.
Nov 03 16:47:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:55 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:47:55 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:47:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:55 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Deleted allocations for instance 16bb1633-adf9-4889-a809-3e4eac1071b9
Nov 03 16:47:55 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a1788a25-84b3-4a17-9635-778a9b7f2558 tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.895s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] Acquiring lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:47:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:47:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] Lock "16bb1633-adf9-4889-a809-3e4eac1071b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:47:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] No waiting events found dispatching network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:47:56 user nova-compute[74932]: WARNING nova.compute.manager [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received unexpected event network-vif-plugged-6e55e6c0-b9a2-46a5-864b-fad6269714ea for instance with vm_state deleted and task_state None.
Nov 03 16:47:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-37b2e97c-ba19-4188-91f4-5484a339382a req-2ce34115-ed73-401a-b1dc-243c443bb5c7 service nova] [instance: 16bb1633-adf9-4889-a809-3e4eac1071b9] Received event network-vif-deleted-6e55e6c0-b9a2-46a5-864b-fad6269714ea {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:47:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:58 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:47:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:47:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:47:58 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updating instance_info_cache with network_info: [{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:47:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:48:02 user nova-compute[74932]: INFO nova.compute.claims [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Claim successful on node user
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:48:02 user nova-compute[74932]: INFO nova.compute.manager [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Rescuing
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:48:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.policy [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd1db8beca33482681f7d7b701d762f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84af8fad5724ccc9e09836bcebb1ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:48:02 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Creating image(s)
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "/opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "/opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "/opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "852c4cde3fa7feba963d3b79db875b56928fa18b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "852c4cde3fa7feba963d3b79db875b56928fa18b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG nova.virt.images [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] 33ef3325-c19c-4110-9b33-639f29d001de was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.part /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updating instance_info_cache with network_info: [{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:48:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Successfully created port: 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.part /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.converted" returned: 0 in 0.403s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-408abe44-b647-4d23-829b-f9cbfabc4930 req-31565bab-ae13-423a-af49-07cbde4c8aca service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-408abe44-b647-4d23-829b-f9cbfabc4930 req-31565bab-ae13-423a-af49-07cbde4c8aca service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-408abe44-b647-4d23-829b-f9cbfabc4930 req-31565bab-ae13-423a-af49-07cbde4c8aca service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-408abe44-b647-4d23-829b-f9cbfabc4930 req-31565bab-ae13-423a-af49-07cbde4c8aca service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.compute.manager [req-408abe44-b647-4d23-829b-f9cbfabc4930 req-31565bab-ae13-423a-af49-07cbde4c8aca service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:04 user nova-compute[74932]: WARNING nova.compute.manager [req-408abe44-b647-4d23-829b-f9cbfabc4930 req-31565bab-ae13-423a-af49-07cbde4c8aca service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state active and task_state rescuing.
Nov 03 16:48:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "852c4cde3fa7feba963d3b79db875b56928fa18b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.616s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "852c4cde3fa7feba963d3b79db875b56928fa18b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "852c4cde3fa7feba963d3b79db875b56928fa18b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b,backing_fmt=raw /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance destroyed successfully.
Nov 03 16:48:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Attempting a stable device rescue
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b,backing_fmt=raw /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk 1073741824" returned: 0 in 0.059s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "852c4cde3fa7feba963d3b79db875b56928fa18b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74932) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance directory exists: not creating {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 16:48:04 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Creating image(s)
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "/opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "/opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'trusted_certs' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "378c8a264508ae22aabb2f936e643f2877487f17" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "378c8a264508ae22aabb2f936e643f2877487f17" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Successfully updated port: 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:48:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:48:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/852c4cde3fa7feba963d3b79db875b56928fa18b --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:05 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:48:05 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.part --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 1.099s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Cannot resize image /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Ensure instance console log exists: /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.images [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] bf5d9b2f-a37d-4b0d-8283-1d761092e36c was qcow2, converting to raw {{(pid=74932) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.privsep.utils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74932) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.part /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.converted {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:06 user nova-compute[74932]: WARNING nova.compute.manager [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state active and task_state rescuing.
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing instance network info cache due to event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.part /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.converted" returned: 0 in 0.541s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.converted --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.neutron [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance network_info: |[{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.neutron [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Start _get_guest_xml network_info=[{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:47:59Z,direct_url=<?>,disk_format='qcow2',id=33ef3325-c19c-4110-9b33-639f29d001de,min_disk=0,min_ram=0,name='tempest-scenario-img--1388462171',owner='a84af8fad5724ccc9e09836bcebb1ada',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:48:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '33ef3325-c19c-4110-9b33-639f29d001de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:48:06 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:48:06 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:47:59Z,direct_url=<?>,disk_format='qcow2',id=33ef3325-c19c-4110-9b33-639f29d001de,min_disk=0,min_ram=0,name='tempest-scenario-img--1388462171',owner='a84af8fad5724ccc9e09836bcebb1ada',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:48:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-408745725',display_name='tempest-TestMinimumBasicScenario-server-408745725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-408745725',id=39,image_ref='33ef3325-c19c-4110-9b33-639f29d001de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNww2dnct6WCy+tYVa3s7aQJibRMKUY7gkrHuifYadCfiK2oaE+OwXk8MmpOZOTtxcWTloeloBOOAS9e5/vuJa7EkoKEeEXmllsMqHGzoKmmMvN4iHbF1HysGfWnjinWQ==',key_name='tempest-TestMinimumBasicScenario-1359277928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-zpfltuo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='33ef3325-c19c-4110-9b33-639f29d001de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:48:03Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=75f63ea9-9367-4609-a446-c064e491dee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.objects.instance [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'pci_devices' on Instance uuid 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:48:06 user nova-compute[74932]:   <uuid>75f63ea9-9367-4609-a446-c064e491dee8</uuid>
Nov 03 16:48:06 user nova-compute[74932]:   <name>instance-00000027</name>
Nov 03 16:48:06 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:48:06 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:48:06 user nova-compute[74932]:   <metadata>
Nov 03 16:48:06 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:48:06 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:48:06 user nova-compute[74932]:       <nova:name>tempest-TestMinimumBasicScenario-server-408745725</nova:name>
Nov 03 16:48:06 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:48:06</nova:creationTime>
Nov 03 16:48:06 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:48:06 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:48:06 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:48:06 user nova-compute[74932]:       <nova:owner>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:user uuid="fd1db8beca33482681f7d7b701d762f6">tempest-TestMinimumBasicScenario-62950615-project-member</nova:user>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:project uuid="a84af8fad5724ccc9e09836bcebb1ada">tempest-TestMinimumBasicScenario-62950615</nova:project>
Nov 03 16:48:06 user nova-compute[74932]:       </nova:owner>
Nov 03 16:48:06 user nova-compute[74932]:       <nova:root type="image" uuid="33ef3325-c19c-4110-9b33-639f29d001de"/>
Nov 03 16:48:06 user nova-compute[74932]:       <nova:ports>
Nov 03 16:48:06 user nova-compute[74932]:         <nova:port uuid="7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c">
Nov 03 16:48:06 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 16:48:06 user nova-compute[74932]:         </nova:port>
Nov 03 16:48:06 user nova-compute[74932]:       </nova:ports>
Nov 03 16:48:06 user nova-compute[74932]:     </nova:instance>
Nov 03 16:48:06 user nova-compute[74932]:   </metadata>
Nov 03 16:48:06 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:48:06 user nova-compute[74932]:     <system>
Nov 03 16:48:06 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:48:06 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:48:06 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:48:06 user nova-compute[74932]:       <entry name="serial">75f63ea9-9367-4609-a446-c064e491dee8</entry>
Nov 03 16:48:06 user nova-compute[74932]:       <entry name="uuid">75f63ea9-9367-4609-a446-c064e491dee8</entry>
Nov 03 16:48:06 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:48:06 user nova-compute[74932]:     </system>
Nov 03 16:48:06 user nova-compute[74932]:   </sysinfo>
Nov 03 16:48:06 user nova-compute[74932]:   <os>
Nov 03 16:48:06 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:48:06 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:48:06 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:48:06 user nova-compute[74932]:   </os>
Nov 03 16:48:06 user nova-compute[74932]:   <features>
Nov 03 16:48:06 user nova-compute[74932]:     <acpi/>
Nov 03 16:48:06 user nova-compute[74932]:     <apic/>
Nov 03 16:48:06 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:48:06 user nova-compute[74932]:   </features>
Nov 03 16:48:06 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:48:06 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:48:06 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:48:06 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:48:06 user nova-compute[74932]:   </clock>
Nov 03 16:48:06 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:48:06 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:48:06 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:48:06 user nova-compute[74932]:   </cpu>
Nov 03 16:48:06 user nova-compute[74932]:   <devices>
Nov 03 16:48:06 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:48:06 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:48:06 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk"/>
Nov 03 16:48:06 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:48:06 user nova-compute[74932]:     </disk>
Nov 03 16:48:06 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:48:06 user nova-compute[74932]:       <mac address="fa:16:3e:88:8b:5c"/>
Nov 03 16:48:06 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:48:06 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:48:06 user nova-compute[74932]:       <target dev="tap7fb740b9-15"/>
Nov 03 16:48:06 user nova-compute[74932]:     </interface>
Nov 03 16:48:06 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:48:06 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/console.log" append="off"/>
Nov 03 16:48:06 user nova-compute[74932]:     </serial>
Nov 03 16:48:06 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:48:06 user nova-compute[74932]:     <video>
Nov 03 16:48:06 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:48:06 user nova-compute[74932]:     </video>
Nov 03 16:48:06 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:48:06 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:48:06 user nova-compute[74932]:     </rng>
Nov 03 16:48:06 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:48:06 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:48:06 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:48:06 user nova-compute[74932]:     </memballoon>
Nov 03 16:48:06 user nova-compute[74932]:   </devices>
Nov 03 16:48:06 user nova-compute[74932]: </domain>
Nov 03 16:48:06 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-408745725',display_name='tempest-TestMinimumBasicScenario-server-408745725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-408745725',id=39,image_ref='33ef3325-c19c-4110-9b33-639f29d001de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNww2dnct6WCy+tYVa3s7aQJibRMKUY7gkrHuifYadCfiK2oaE+OwXk8MmpOZOTtxcWTloeloBOOAS9e5/vuJa7EkoKEeEXmllsMqHGzoKmmMvN4iHbF1HysGfWnjinWQ==',key_name='tempest-TestMinimumBasicScenario-1359277928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-zpfltuo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='33ef3325-c19c-4110-9b33-639f29d001de',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:48:03Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=75f63ea9-9367-4609-a446-c064e491dee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG os_vif [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e48623f1-230b-54b9-969e-f4a1f95dd4df', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fb740b9-15, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fb740b9-15, col_values=(('qos', UUID('b6ea115a-cac2-440f-808c-95cad5fb595b')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fb740b9-15, col_values=(('external_ids', {'iface-id': '7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:8b:5c', 'vm-uuid': '75f63ea9-9367-4609-a446-c064e491dee8'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:07 user nova-compute[74932]: INFO os_vif [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15')
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "378c8a264508ae22aabb2f936e643f2877487f17" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.106s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "378c8a264508ae22aabb2f936e643f2877487f17" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "378c8a264508ae22aabb2f936e643f2877487f17" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No VIF found with MAC fa:16:3e:88:8b:5c, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17 --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17,backing_fmt=raw /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/378c8a264508ae22aabb2f936e643f2877487f17,backing_fmt=raw /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue" returned: 0 in 0.051s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "378c8a264508ae22aabb2f936e643f2877487f17" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'migration_context' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<f92a2cae-8a28-47b6-965f-17d8e7952287> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Start _get_guest_xml network_info=[{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "vif_mac": "fa:16:3e:fd:82:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf5d9b2f-a37d-4b0d-8283-1d761092e36c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f92a2cae-8a28-47b6-965f-17d8e7952287', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'serial': 'b9582e02-80c5-48d0-9e82-07019f1ecf0b'}, 'attachment_id': '8e0d53d6-0cc5-4e0e-82a6-b6724eb2f5e0', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'resources' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<f92a2cae-8a28-47b6-965f-17d8e7952287> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'numa_topology' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<f92a2cae-8a28-47b6-965f-17d8e7952287> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updated VIF entry in instance network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.network.neutron [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:48:07 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:48:07 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'vcpu_model' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2bc0bbb9-808f-4fd5-8365-7074bd3c947e req-fea11f7e-5afa-42f1-8111-e9ab810a0a4c service nova] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<f92a2cae-8a28-47b6-965f-17d8e7952287> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:48:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:48:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:48:07 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c45625-860b-4ff6-b1f2-8c51bad977b3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sIHOqNCz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 16:48:07 user nova-compute[74932]: node.name = iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b
Nov 03 16:48:07 user nova-compute[74932]: node.tpgt = -1
Nov 03 16:48:07 user nova-compute[74932]: node.startup = automatic
Nov 03 16:48:07 user nova-compute[74932]: node.leading_login = No
Nov 03 16:48:07 user nova-compute[74932]: iface.iscsi_ifacename = default
Nov 03 16:48:07 user nova-compute[74932]: iface.net_ifacename = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.ipaddress = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.prefix_len = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.hwaddress = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.transport_name = tcp
Nov 03 16:48:07 user nova-compute[74932]: iface.initiatorname = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.vlan_id = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.vlan_priority = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.vlan_state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.iface_num = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.mtu = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.port = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.bootproto = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.subnet_mask = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.gateway = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_alt_client_id = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_dns = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_learn_iqn = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_vendor_id_state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_vendor_id = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.dhcp_slp_da = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.fragmentation = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.gratuitous_arp = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.incoming_forwarding = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.tos_state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.tos = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.ttl = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.delayed_ack = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.tcp_nagle = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.tcp_wsf_state = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.tcp_wsf = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.tcp_timer_scale = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.tcp_timestamp = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.redirect = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.def_task_mgmt_timeout = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.header_digest = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.data_digest = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.immediate_data = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.initial_r2t = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.data_seq_inorder = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.data_pdu_inorder = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.erl = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.max_receive_data_len = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.first_burst_len = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.max_outstanding_r2t = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.max_burst_len = 0
Nov 03 16:48:07 user nova-compute[74932]: iface.chap_auth = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.bidi_chap = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.strict_login_compliance = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.discovery_auth = <empty>
Nov 03 16:48:07 user nova-compute[74932]: iface.discovery_logout = <empty>
Nov 03 16:48:07 user nova-compute[74932]: node.discovery_address = <empty>
Nov 03 16:48:07 user nova-compute[74932]: node.discovery_port = 0
Nov 03 16:48:07 user nova-compute[74932]: node.discovery_type = static
Nov 03 16:48:07 user nova-compute[74932]: node.session.initial_cmdsn = 0
Nov 03 16:48:07 user nova-compute[74932]: node.session.initial_login_retry_max = 8
Nov 03 16:48:07 user nova-compute[74932]: node.session.xmit_thread_priority = -20
Nov 03 16:48:07 user nova-compute[74932]: node.session.cmds_max = 128
Nov 03 16:48:07 user nova-compute[74932]: node.session.queue_depth = 32
Nov 03 16:48:07 user nova-compute[74932]: node.session.nr_sessions = 1
Nov 03 16:48:07 user nova-compute[74932]: node.session.auth.authmethod = CHAP
Nov 03 16:48:07 user nova-compute[74932]: node.session.auth.username = sIHOqNCz
Nov 03 16:48:07 user nova-compute[74932]: node.session.auth.password = ***
Nov 03 16:48:07 user nova-compute[74932]: node.session.auth.username_in = <empty>
Nov 03 16:48:07 user nova-compute[74932]: node.session.auth.password_in = <empty>
Nov 03 16:48:07 user nova-compute[74932]: node.session.auth.chap_algs = MD5
Nov 03 16:48:07 user nova-compute[74932]: node.session.timeo.replacement_timeout = 120
Nov 03 16:48:07 user nova-compute[74932]: node.session.err_timeo.abort_timeout = 15
Nov 03 16:48:07 user nova-compute[74932]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 16:48:07 user nova-compute[74932]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 16:48:07 user nova-compute[74932]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.FastAbort = Yes
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.InitialR2T = No
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.ImmediateData = Yes
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.MaxConnections = 1
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 16:48:07 user nova-compute[74932]: node.session.iscsi.ERL = 0
Nov 03 16:48:07 user nova-compute[74932]: node.session.scan = manual
Nov 03 16:48:07 user nova-compute[74932]: node.session.reopen_max = 0
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].address = 172.16.0.220
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].port = 3260
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].startup = manual
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].tcp.window_size = 524288
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].tcp.type_of_service = 0
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].timeo.logout_timeout = 15
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].timeo.login_timeout = 15
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].timeo.auth_timeout = 45
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].iscsi.DataDigest = None
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].iscsi.IFMarker = No
Nov 03 16:48:07 user nova-compute[74932]: node.conn[0].iscsi.OFMarker = No
Nov 03 16:48:07 user nova-compute[74932]: # END RECORD
Nov 03 16:48:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c34d284-c977-452f-bf36-afaa88834768]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46ed7ae-6ce9-4037-b909-520e4695bb60]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIHOqNCz {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIHOqNCz" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f96fb37-2e5d-4900-8e90-3a6fddb51305]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIHOqNCz'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80ff800-f559-4cc9-bcd2-57db4b19bbe0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac635f5-405e-4915-9c53-1714bdd9053e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:48:07 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:48:07 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:48:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:48:07 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:48:07 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:48:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] HCTL ('36', '0', '0', 0) found on session 39 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a81265-cd26-42d7-bb24-8d57d35232fe]: (4, ('0 0 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Searching for a device in session 39 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '26366303863393735', 'path': '/dev/sde'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366303863393735', 'path': '/dev/sde'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261612924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261612924',id=38,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-f1vwdf0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:46:55Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=f92a2cae-8a28-47b6-965f-17d8e7952287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "vif_mac": "fa:16:3e:fd:82:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "vif_mac": "fa:16:3e:fd:82:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'pci_devices' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.objects.base [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Object Instance<f92a2cae-8a28-47b6-965f-17d8e7952287> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74932) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:48:07 user nova-compute[74932]:   <uuid>f92a2cae-8a28-47b6-965f-17d8e7952287</uuid>
Nov 03 16:48:07 user nova-compute[74932]:   <name>instance-00000026</name>
Nov 03 16:48:07 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:48:07 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:48:07 user nova-compute[74932]:   <metadata>
Nov 03 16:48:07 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:48:07 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:48:07 user nova-compute[74932]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-261612924</nova:name>
Nov 03 16:48:07 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:48:07</nova:creationTime>
Nov 03 16:48:07 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:48:07 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:48:07 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:48:07 user nova-compute[74932]:       <nova:owner>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:user uuid="f2fbcaa1d5bb4249b127dcdc0875517a">tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member</nova:user>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:project uuid="5f123f628d784aaaadba9dea7eb71ce2">tempest-ServerBootFromVolumeStableRescueTest-2083155834</nova:project>
Nov 03 16:48:07 user nova-compute[74932]:       </nova:owner>
Nov 03 16:48:07 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:48:07 user nova-compute[74932]:       <nova:ports>
Nov 03 16:48:07 user nova-compute[74932]:         <nova:port uuid="594aaaa2-8eca-45bc-942e-6d20701efef9">
Nov 03 16:48:07 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 16:48:07 user nova-compute[74932]:         </nova:port>
Nov 03 16:48:07 user nova-compute[74932]:       </nova:ports>
Nov 03 16:48:07 user nova-compute[74932]:     </nova:instance>
Nov 03 16:48:07 user nova-compute[74932]:   </metadata>
Nov 03 16:48:07 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:48:07 user nova-compute[74932]:     <system>
Nov 03 16:48:07 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:48:07 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:48:07 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:48:07 user nova-compute[74932]:       <entry name="serial">f92a2cae-8a28-47b6-965f-17d8e7952287</entry>
Nov 03 16:48:07 user nova-compute[74932]:       <entry name="uuid">f92a2cae-8a28-47b6-965f-17d8e7952287</entry>
Nov 03 16:48:07 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:48:07 user nova-compute[74932]:     </system>
Nov 03 16:48:07 user nova-compute[74932]:   </sysinfo>
Nov 03 16:48:07 user nova-compute[74932]:   <os>
Nov 03 16:48:07 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:48:07 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:48:07 user nova-compute[74932]:   </os>
Nov 03 16:48:07 user nova-compute[74932]:   <features>
Nov 03 16:48:07 user nova-compute[74932]:     <acpi/>
Nov 03 16:48:07 user nova-compute[74932]:     <apic/>
Nov 03 16:48:07 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:48:07 user nova-compute[74932]:   </features>
Nov 03 16:48:07 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:48:07 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:48:07 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:48:07 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:48:07 user nova-compute[74932]:   </clock>
Nov 03 16:48:07 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:48:07 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:48:07 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:48:07 user nova-compute[74932]:   </cpu>
Nov 03 16:48:07 user nova-compute[74932]:   <devices>
Nov 03 16:48:07 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:48:07 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:48:07 user nova-compute[74932]:       <source dev="/dev/sde"/>
Nov 03 16:48:07 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:48:07 user nova-compute[74932]:       <serial>b9582e02-80c5-48d0-9e82-07019f1ecf0b</serial>
Nov 03 16:48:07 user nova-compute[74932]:     </disk>
Nov 03 16:48:07 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:48:07 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:48:07 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue"/>
Nov 03 16:48:07 user nova-compute[74932]:       <target dev="vdb" bus="virtio"/>
Nov 03 16:48:07 user nova-compute[74932]:       <boot order="1"/>
Nov 03 16:48:07 user nova-compute[74932]:     </disk>
Nov 03 16:48:07 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:48:07 user nova-compute[74932]:       <mac address="fa:16:3e:fd:82:34"/>
Nov 03 16:48:07 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:48:07 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:48:07 user nova-compute[74932]:       <target dev="tap594aaaa2-8e"/>
Nov 03 16:48:07 user nova-compute[74932]:     </interface>
Nov 03 16:48:07 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:48:07 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/console.log" append="off"/>
Nov 03 16:48:07 user nova-compute[74932]:     </serial>
Nov 03 16:48:07 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:48:07 user nova-compute[74932]:     <video>
Nov 03 16:48:07 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:48:07 user nova-compute[74932]:     </video>
Nov 03 16:48:07 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:48:07 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:48:07 user nova-compute[74932]:     </rng>
Nov 03 16:48:07 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:48:07 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:48:07 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:48:07 user nova-compute[74932]:     </memballoon>
Nov 03 16:48:07 user nova-compute[74932]:   </devices>
Nov 03 16:48:07 user nova-compute[74932]: </domain>
Nov 03 16:48:07 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:48:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance destroyed successfully.
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:48:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] No VIF found with MAC fa:16:3e:fd:82:34, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:48:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:08 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-78983aac-fd6d-4e9c-b38f-6268b3bc2b9f req-9f172801-07ec-44d3-b346-24ba69d95a3e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-78983aac-fd6d-4e9c-b38f-6268b3bc2b9f req-9f172801-07ec-44d3-b346-24ba69d95a3e service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-78983aac-fd6d-4e9c-b38f-6268b3bc2b9f req-9f172801-07ec-44d3-b346-24ba69d95a3e service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-78983aac-fd6d-4e9c-b38f-6268b3bc2b9f req-9f172801-07ec-44d3-b346-24ba69d95a3e service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-78983aac-fd6d-4e9c-b38f-6268b3bc2b9f req-9f172801-07ec-44d3-b346-24ba69d95a3e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:09 user nova-compute[74932]: WARNING nova.compute.manager [req-78983aac-fd6d-4e9c-b38f-6268b3bc2b9f req-9f172801-07ec-44d3-b346-24ba69d95a3e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state building and task_state spawning.
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:11 user nova-compute[74932]: WARNING nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state building and task_state spawning.
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:11 user nova-compute[74932]: WARNING nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state active and task_state rescuing.
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:11 user nova-compute[74932]: WARNING nova.compute.manager [req-feedf45a-0ec7-4787-8f4a-c925ca2d8f95 req-0dd091fc-d420-4c66-9bad-aae65a471e0b service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state active and task_state rescuing.
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:48:12 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance spawned successfully.
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3638628e-d97a-447d-bcf6-fa1c7ead905d tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:48:12 user nova-compute[74932]: INFO nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Took 9.43 seconds to spawn the instance on the hypervisor.
Nov 03 16:48:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:48:12 user nova-compute[74932]: INFO nova.compute.manager [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Took 10.18 seconds to build instance.
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-75c95903-7b38-4550-a818-1c5722ec6e7e tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.285s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:48:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:48:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:48:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8292MB free_disk=24.78369140625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 1ed9acd4-1794-429c-9c37-84a58024947c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 36b59795-c633-412e-92f4-280e6daeec54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f92a2cae-8a28-47b6-965f-17d8e7952287 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 75f63ea9-9367-4609-a446-c064e491dee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:48:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:16 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "1ed9acd4-1794-429c-9c37-84a58024947c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:44 user nova-compute[74932]: INFO nova.compute.manager [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Terminating instance
Nov 03 16:48:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-99edb32a-322f-4d13-84dd-c9aaa6058ce2 req-cd95fb2c-db0a-42d4-946d-2fb04ccd5b61 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-99edb32a-322f-4d13-84dd-c9aaa6058ce2 req-cd95fb2c-db0a-42d4-946d-2fb04ccd5b61 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-99edb32a-322f-4d13-84dd-c9aaa6058ce2 req-cd95fb2c-db0a-42d4-946d-2fb04ccd5b61 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-99edb32a-322f-4d13-84dd-c9aaa6058ce2 req-cd95fb2c-db0a-42d4-946d-2fb04ccd5b61 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-99edb32a-322f-4d13-84dd-c9aaa6058ce2 req-cd95fb2c-db0a-42d4-946d-2fb04ccd5b61 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-99edb32a-322f-4d13-84dd-c9aaa6058ce2 req-cd95fb2c-db0a-42d4-946d-2fb04ccd5b61 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-unplugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:48:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Instance destroyed successfully.
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.objects.instance [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lazy-loading 'resources' on Instance uuid 1ed9acd4-1794-429c-9c37-84a58024947c {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:30:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2063351239',display_name='tempest-ServerRescueNegativeTestJSON-server-2063351239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2063351239',id=18,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1f1557f72d4ca1ac1d34772c23a953',ramdisk_id='',reservation_id='r-39nqenhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1518505179',owner_user_name='tempest-ServerRescueNegativeTestJSON-1518505179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:37:43Z,user_data=None,user_id='462c0b16a5f744e49b3ee3ef8ee39e00',uuid=1ed9acd4-1794-429c-9c37-84a58024947c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converting VIF {"id": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "address": "fa:16:3e:28:95:4e", "network": {"id": "b3047938-8e2e-4730-a3e1-c4029caf12c6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-447900084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1f1557f72d4ca1ac1d34772c23a953", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap383bb4bc-f4", "ovs_interfaceid": "383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG os_vif [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap383bb4bc-f4, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=540b5a91-e7f3-45b6-ad41-b3bcb505c2d4) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:48:45 user nova-compute[74932]: INFO os_vif [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:95:4e,bridge_name='br-int',has_traffic_filtering=True,id=383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c,network=Network(b3047938-8e2e-4730-a3e1-c4029caf12c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap383bb4bc-f4')
Nov 03 16:48:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Deleting instance files /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c_del
Nov 03 16:48:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Deletion of /opt/stack/data/nova/instances/1ed9acd4-1794-429c-9c37-84a58024947c_del complete
Nov 03 16:48:45 user nova-compute[74932]: INFO nova.compute.manager [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 03 16:48:45 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:48:45 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Took 0.50 seconds to deallocate network for instance.
Nov 03 16:48:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:46 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Deleted allocations for instance 1ed9acd4-1794-429c-9c37-84a58024947c
Nov 03 16:48:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-b29dbca8-fcaf-4833-81ed-6946e2a9e62d tempest-ServerRescueNegativeTestJSON-1518505179 tempest-ServerRescueNegativeTestJSON-1518505179-project-member] Lock "1ed9acd4-1794-429c-9c37-84a58024947c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] Acquiring lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] Lock "1ed9acd4-1794-429c-9c37-84a58024947c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:48:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] No waiting events found dispatching network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:48:46 user nova-compute[74932]: WARNING nova.compute.manager [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received unexpected event network-vif-plugged-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c for instance with vm_state deleted and task_state None.
Nov 03 16:48:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-b664acb3-4ed6-4d91-af54-cad95bad10bb req-5c0b7859-157a-4e9d-9632-ac90bd6877b3 service nova] [instance: 1ed9acd4-1794-429c-9c37-84a58024947c] Received event network-vif-deleted-383bb4bc-f402-4a1c-ae7b-dd4e8e3ca26c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:48:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:48:55 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:48:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:48:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:48:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:48:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:49:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:08 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:49:09 user nova-compute[74932]: INFO nova.compute.claims [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Claim successful on node user
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.policy [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd7108d051f4052882dc2855457da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111f571583f844359234fa4760d45a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:49:10 user nova-compute[74932]: INFO nova.virt.block_device [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Booting with volume 159abfc0-d3de-451a-9792-7589be8c6bfb at /dev/vda
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG os_brick.utils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e9091a-693e-4588-a3a9-262abee0e08b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[239d51d0-91e0-4147-a785-c3c3ab7133aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf9d688-5271-4090-8646-e3bedf661df4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3395a-0712-4cd6-a4f6-65db1c2602ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:49:10 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:49:10 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95c8ab9-d196-4af7-b13f-70f43ec2b1e6]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG os_brick.utils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:49:10 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updating existing volume attachment record: 065a4184-fbdb-4653-ba12-6b1127a17ef3 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:49:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:49:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=24.76419448852539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Successfully created port: 56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 36b59795-c633-412e-92f4-280e6daeec54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f92a2cae-8a28-47b6-965f-17d8e7952287 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 75f63ea9-9367-4609-a446-c064e491dee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d4d93b47-184d-4639-a7cf-955ab0c2c017 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Successfully updated port: 56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquired lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-changed-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Refreshing instance network info cache due to event network-changed-56715109-0229-49da-913e-8e5b7849e715. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] Acquiring lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:49:11 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG nova.network.neutron [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updating instance_info_cache with network_info: [{"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Releasing lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Instance network_info: |[{"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] Acquired lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Refreshing network info cache for port 56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updated VIF entry in instance network info cache for port 56715109-0229-49da-913e-8e5b7849e715. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG nova.network.neutron [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updating instance_info_cache with network_info: [{"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:49:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9481ad8c-7e7b-488b-8c8e-64b044fe26d2 req-ea3df0a4-bfbf-4207-a7d6-635fe5d6e111 service nova] Releasing lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:49:13 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:25 user nova-compute[74932]: WARNING nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 0d0016ac-ccd0-45b7-936b-ff0da827760b {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 11fb8f0c-e8fc-4248-a522-582a859fca29 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 995b57a0-17c8-4dc5-bc97-84c0a386bad8 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 36b59795-c633-412e-92f4-280e6daeec54 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Triggering sync for uuid d4d93b47-184d-4639-a7cf-955ab0c2c017 {{(pid=74932) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "36b59795-c633-412e-92f4-280e6daeec54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "36b59795-c633-412e-92f4-280e6daeec54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:49:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Creating image(s)
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Ensure instance console log exists: /opt/stack/data/nova/instances/d4d93b47-184d-4639-a7cf-955ab0c2c017/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Start _get_guest_xml network_info=[{"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdDfSyLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4d93b47-184d-4639-a7cf-955ab0c2c017', 'attached_at': '', 'detached_at': '', 'volume_id': '159abfc0-d3de-451a-9792-7589be8c6bfb', 'serial': '159abfc0-d3de-451a-9792-7589be8c6bfb'}, 'attachment_id': '065a4184-fbdb-4653-ba12-6b1127a17ef3', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:49:30 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:49:30 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdDfSyLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:49:30 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:49:30 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:49:30 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:49:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[97496baf-71e6-4a80-9d1b-d0bda8e362f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:49:30 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a58749-c33c-415c-87fd-3c0bd855c553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb] added
Nov 03 16:49:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3d6ca2-5b91-4ca3-9363-c73d33bf2a0c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[20442804-9ef4-4378-af8e-3ca3138087f5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdDfSyLn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdDfSyLn" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa2c78-8810-4f2f-85e9-4710c985508b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MdDfSyLn'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a69f68-5aeb-45e5-86d4-4c75361b5383]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbdbee7-5114-4eaf-898d-cf22872969b7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:49:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:49:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3dd317-7b1d-46f3-b8a8-f3e9cebf6d45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260]
Nov 03 16:49:30 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260] successful.
Nov 03 16:49:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[57195ed1-834c-47dd-9092-79d5ff460085]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e678fc-d414-4f07-a87a-2dc173c260ed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:49:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:49:30 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:49:30 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055a11c-847f-4735-99ac-5bb9f0b60c8d]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:30 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdDfSyLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23735656530623966', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735656530623966', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-421782136',display_name='tempest-TestVolumeBootPattern-volume-backed-server-421782136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-421782136',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+NxEzxfGlsZo5MQ+9PpK7X/tJQ6Jg/fzXxhZHJ7tkcXs0LMG8JhUWGmRmcFXEhi4WMm45+MR8xVKWrjHzE/sYEitOI85O98YJjgc5gwnMiBfCoZIYCgS/L6LiykTkFBw==',key_name='tempest-keypair-1346928800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-djx9lxvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd7108d051f4052882dc2855457da38',uuid=d4d93b47-184d-4639-a7cf-955ab0c2c017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.objects.instance [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'pci_devices' on Instance uuid d4d93b47-184d-4639-a7cf-955ab0c2c017 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:49:31 user nova-compute[74932]:   <uuid>d4d93b47-184d-4639-a7cf-955ab0c2c017</uuid>
Nov 03 16:49:31 user nova-compute[74932]:   <name>instance-00000028</name>
Nov 03 16:49:31 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:49:31 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:49:31 user nova-compute[74932]:   <metadata>
Nov 03 16:49:31 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:49:31 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:49:31 user nova-compute[74932]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-421782136</nova:name>
Nov 03 16:49:31 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:49:30</nova:creationTime>
Nov 03 16:49:31 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:49:31 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:49:31 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:49:31 user nova-compute[74932]:       <nova:owner>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:user uuid="9cd7108d051f4052882dc2855457da38">tempest-TestVolumeBootPattern-1760430654-project-member</nova:user>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:project uuid="111f571583f844359234fa4760d45a35">tempest-TestVolumeBootPattern-1760430654</nova:project>
Nov 03 16:49:31 user nova-compute[74932]:       </nova:owner>
Nov 03 16:49:31 user nova-compute[74932]:       <nova:ports>
Nov 03 16:49:31 user nova-compute[74932]:         <nova:port uuid="56715109-0229-49da-913e-8e5b7849e715">
Nov 03 16:49:31 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 16:49:31 user nova-compute[74932]:         </nova:port>
Nov 03 16:49:31 user nova-compute[74932]:       </nova:ports>
Nov 03 16:49:31 user nova-compute[74932]:     </nova:instance>
Nov 03 16:49:31 user nova-compute[74932]:   </metadata>
Nov 03 16:49:31 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:49:31 user nova-compute[74932]:     <system>
Nov 03 16:49:31 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:49:31 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:49:31 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:49:31 user nova-compute[74932]:       <entry name="serial">d4d93b47-184d-4639-a7cf-955ab0c2c017</entry>
Nov 03 16:49:31 user nova-compute[74932]:       <entry name="uuid">d4d93b47-184d-4639-a7cf-955ab0c2c017</entry>
Nov 03 16:49:31 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:49:31 user nova-compute[74932]:     </system>
Nov 03 16:49:31 user nova-compute[74932]:   </sysinfo>
Nov 03 16:49:31 user nova-compute[74932]:   <os>
Nov 03 16:49:31 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:49:31 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:49:31 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:49:31 user nova-compute[74932]:   </os>
Nov 03 16:49:31 user nova-compute[74932]:   <features>
Nov 03 16:49:31 user nova-compute[74932]:     <acpi/>
Nov 03 16:49:31 user nova-compute[74932]:     <apic/>
Nov 03 16:49:31 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:49:31 user nova-compute[74932]:   </features>
Nov 03 16:49:31 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:49:31 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:49:31 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:49:31 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:49:31 user nova-compute[74932]:   </clock>
Nov 03 16:49:31 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:49:31 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:49:31 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:49:31 user nova-compute[74932]:   </cpu>
Nov 03 16:49:31 user nova-compute[74932]:   <devices>
Nov 03 16:49:31 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:49:31 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:49:31 user nova-compute[74932]:       <source dev="/dev/sdc"/>
Nov 03 16:49:31 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:49:31 user nova-compute[74932]:       <serial>159abfc0-d3de-451a-9792-7589be8c6bfb</serial>
Nov 03 16:49:31 user nova-compute[74932]:     </disk>
Nov 03 16:49:31 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:49:31 user nova-compute[74932]:       <mac address="fa:16:3e:08:bd:82"/>
Nov 03 16:49:31 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:49:31 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:49:31 user nova-compute[74932]:       <target dev="tap56715109-02"/>
Nov 03 16:49:31 user nova-compute[74932]:     </interface>
Nov 03 16:49:31 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:49:31 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/d4d93b47-184d-4639-a7cf-955ab0c2c017/console.log" append="off"/>
Nov 03 16:49:31 user nova-compute[74932]:     </serial>
Nov 03 16:49:31 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:49:31 user nova-compute[74932]:     <video>
Nov 03 16:49:31 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:49:31 user nova-compute[74932]:     </video>
Nov 03 16:49:31 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:49:31 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:49:31 user nova-compute[74932]:     </rng>
Nov 03 16:49:31 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:49:31 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:49:31 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:49:31 user nova-compute[74932]:     </memballoon>
Nov 03 16:49:31 user nova-compute[74932]:   </devices>
Nov 03 16:49:31 user nova-compute[74932]: </domain>
Nov 03 16:49:31 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-421782136',display_name='tempest-TestVolumeBootPattern-volume-backed-server-421782136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-421782136',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+NxEzxfGlsZo5MQ+9PpK7X/tJQ6Jg/fzXxhZHJ7tkcXs0LMG8JhUWGmRmcFXEhi4WMm45+MR8xVKWrjHzE/sYEitOI85O98YJjgc5gwnMiBfCoZIYCgS/L6LiykTkFBw==',key_name='tempest-keypair-1346928800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-djx9lxvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd7108d051f4052882dc2855457da38',uuid=d4d93b47-184d-4639-a7cf-955ab0c2c017,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG os_vif [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae1ec175-4fc6-535c-8d59-1b8ca23085a8', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56715109-02, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56715109-02, col_values=(('qos', UUID('92a258fd-ed7c-45df-8b2e-3c1e4780855b')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56715109-02, col_values=(('external_ids', {'iface-id': '56715109-0229-49da-913e-8e5b7849e715', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:bd:82', 'vm-uuid': 'd4d93b47-184d-4639-a7cf-955ab0c2c017'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:31 user nova-compute[74932]: INFO os_vif [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02')
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:49:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No VIF found with MAC fa:16:3e:08:bd:82, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:49:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG nova.compute.manager [req-7a9e3777-472c-48f9-bf54-d36b8d5b2a2e req-380c11b7-624e-44f1-be28-df85ae057875 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7a9e3777-472c-48f9-bf54-d36b8d5b2a2e req-380c11b7-624e-44f1-be28-df85ae057875 service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7a9e3777-472c-48f9-bf54-d36b8d5b2a2e req-380c11b7-624e-44f1-be28-df85ae057875 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7a9e3777-472c-48f9-bf54-d36b8d5b2a2e req-380c11b7-624e-44f1-be28-df85ae057875 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG nova.compute.manager [req-7a9e3777-472c-48f9-bf54-d36b8d5b2a2e req-380c11b7-624e-44f1-be28-df85ae057875 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:49:33 user nova-compute[74932]: WARNING nova.compute.manager [req-7a9e3777-472c-48f9-bf54-d36b8d5b2a2e req-380c11b7-624e-44f1-be28-df85ae057875 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received unexpected event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 for instance with vm_state building and task_state spawning.
Nov 03 16:49:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:49:35 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Instance spawned successfully.
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:49:35 user nova-compute[74932]: INFO nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:49:35 user nova-compute[74932]: INFO nova.compute.manager [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Took 25.92 seconds to build instance.
Nov 03 16:49:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-dc0dc491-7b6b-4613-aec2-85de4392d05a tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.021s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.659s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:35 user nova-compute[74932]: INFO nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 03 16:49:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-eaf6f8fa-adf3-441e-a4b0-fcaa4d6cb8bb req-f43e28bb-472b-4387-813e-fe46185fe3cf service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eaf6f8fa-adf3-441e-a4b0-fcaa4d6cb8bb req-f43e28bb-472b-4387-813e-fe46185fe3cf service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eaf6f8fa-adf3-441e-a4b0-fcaa4d6cb8bb req-f43e28bb-472b-4387-813e-fe46185fe3cf service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-eaf6f8fa-adf3-441e-a4b0-fcaa4d6cb8bb req-f43e28bb-472b-4387-813e-fe46185fe3cf service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-eaf6f8fa-adf3-441e-a4b0-fcaa4d6cb8bb req-f43e28bb-472b-4387-813e-fe46185fe3cf service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:49:35 user nova-compute[74932]: WARNING nova.compute.manager [req-eaf6f8fa-adf3-441e-a4b0-fcaa4d6cb8bb req-f43e28bb-472b-4387-813e-fe46185fe3cf service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received unexpected event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 for instance with vm_state active and task_state None.
Nov 03 16:49:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:43 user nova-compute[74932]: INFO nova.compute.manager [None req-741b48f4-84bb-409a-a786-f5bda20c03e2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Get console output
Nov 03 16:49:43 user nova-compute[74932]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 03 16:49:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:49:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:49:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:49:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:49:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:53 user nova-compute[74932]: INFO nova.compute.manager [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Unrescuing
Nov 03 16:49:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquired lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG nova.network.neutron [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updating instance_info_cache with network_info: [{"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Releasing lock "refresh_cache-f92a2cae-8a28-47b6-965f-17d8e7952287" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'flavor' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-2231b6c8-df43-493f-ac74-3b65061f0c6f req-8ba58348-e171-41f5-86c2-b8179e690938 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2231b6c8-df43-493f-ac74-3b65061f0c6f req-8ba58348-e171-41f5-86c2-b8179e690938 service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2231b6c8-df43-493f-ac74-3b65061f0c6f req-8ba58348-e171-41f5-86c2-b8179e690938 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-2231b6c8-df43-493f-ac74-3b65061f0c6f req-8ba58348-e171-41f5-86c2-b8179e690938 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-2231b6c8-df43-493f-ac74-3b65061f0c6f req-8ba58348-e171-41f5-86c2-b8179e690938 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:49:54 user nova-compute[74932]: WARNING nova.compute.manager [req-2231b6c8-df43-493f-ac74-3b65061f0c6f req-8ba58348-e171-41f5-86c2-b8179e690938 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:49:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:54 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance destroyed successfully.
Nov 03 16:49:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:49:56 user nova-compute[74932]: WARNING nova.compute.manager [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:49:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:49:56 user nova-compute[74932]: WARNING nova.compute.manager [req-008148a3-b374-4884-8230-42dd40e5c5bb req-fd57aaa9-4283-4104-a41e-5fb0320a0d9d service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state rescued and task_state unrescuing.
Nov 03 16:49:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d5006954-a896-4705-b1a7-a15831c282cb tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-01893483-e4fc-48d2-b730-0abd255ea98b req-8ccbfd68-9077-41b0-904d-037c737f1a91 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-01893483-e4fc-48d2-b730-0abd255ea98b req-8ccbfd68-9077-41b0-904d-037c737f1a91 service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-01893483-e4fc-48d2-b730-0abd255ea98b req-8ccbfd68-9077-41b0-904d-037c737f1a91 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-01893483-e4fc-48d2-b730-0abd255ea98b req-8ccbfd68-9077-41b0-904d-037c737f1a91 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG nova.compute.manager [req-01893483-e4fc-48d2-b730-0abd255ea98b req-8ccbfd68-9077-41b0-904d-037c737f1a91 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:49:58 user nova-compute[74932]: WARNING nova.compute.manager [req-01893483-e4fc-48d2-b730-0abd255ea98b req-8ccbfd68-9077-41b0-904d-037c737f1a91 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state active and task_state None.
Nov 03 16:49:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'flavor' on Instance uuid 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:49:58 user nova-compute[74932]: INFO nova.compute.manager [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Attaching volume c851d892-86d3-4b19-ab20-7ec392145b83 to /dev/vdb
Nov 03 16:49:58 user nova-compute[74932]: DEBUG os_brick.utils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c428dfa-eaa8-40a0-9a71-1d317db62e61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba4732c-b7a0-4d8c-812f-e1883084fde6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2769e7-ac34-41fe-88f0-a9e6d2ee3cb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a7a92-e21d-4855-9b8c-b460151a14fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:49:58 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:49:59 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:49:59 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f51c9c-52b1-4ffd-95c9-6825fcb226bb]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG os_brick.utils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating existing volume attachment record: 04aa1c4f-99c6-4a0d-9d36-f5f89210b313 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:49:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:50:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:50:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:50:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:50:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Updating instance_info_cache with network_info: [{"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:50:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-995b57a0-17c8-4dc5-bc97-84c0a386bad8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:50:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:50:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:50:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:50:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=24.75452423095703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 36b59795-c633-412e-92f4-280e6daeec54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f92a2cae-8a28-47b6-965f-17d8e7952287 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 75f63ea9-9367-4609-a446-c064e491dee8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d4d93b47-184d-4639-a7cf-955ab0c2c017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:50:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:50:12 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:50:12 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:50:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:50:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:13 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:15 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRtakAdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:50:19 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:50:19 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:50:19 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50a8d6-d080-415c-8bbd-be2825e8622a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:50:19 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d9cd71-f975-49ed-a030-c98b999bce85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83] added
Nov 03 16:50:19 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fe19c6-9059-42f8-b3ce-60b7b5592090]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f778ba0c-a8fd-4fe6-850f-0667aa3f1996]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRtakAdo {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRtakAdo" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e8bbe-bd64-426f-a8e7-a2589637b1bf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRtakAdo'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:19 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c2a3ad-76ab-42f1-b29a-c5d0fc86bd61]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8601f74-e5c8-4f30-b9af-253c673b0b00]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:50:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:50:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6034a-15e6-4e71-95b3-c338fe804e6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260]
Nov 03 16:50:20 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260] successful.
Nov 03 16:50:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b63696-9a41-4b42-86ce-7119d49a9479]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1464c3-e74e-47aa-9e33-c94fe61d2785]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:50:20 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:50:20 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69bcec-5a7c-4e5e-8de6-833ea72f2cc7]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:50:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRtakAdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26534356231326464', 'path': '/dev/sdf'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534356231326464', 'path': '/dev/sdf'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'flavor' on Instance uuid 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:50:21 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:50:21 user nova-compute[74932]:   <source dev="/dev/sdf"/>
Nov 03 16:50:21 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:50:21 user nova-compute[74932]:   <serial>c851d892-86d3-4b19-ab20-7ec392145b83</serial>
Nov 03 16:50:21 user nova-compute[74932]: </disk>
Nov 03 16:50:21 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] No VIF found with MAC fa:16:3e:88:8b:5c, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:21 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e330cdbc-091a-4926-9433-b2efeee5b5fe tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.970s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing instance network info cache due to event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:50:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:50:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:50:24 user nova-compute[74932]: DEBUG nova.network.neutron [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:50:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updated VIF entry in instance network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:50:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:50:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-26181240-a7e0-436d-84f3-47ea59ef4ddb req-8072e02e-0986-4d1a-a346-1f45b43ffe6d service nova] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:50:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing instance network info cache due to event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:50:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:50:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:50:26 user nova-compute[74932]: DEBUG nova.network.neutron [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:50:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG nova.network.neutron [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updated VIF entry in instance network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG nova.network.neutron [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:27 user nova-compute[74932]: INFO nova.compute.manager [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Rebooting instance
Nov 03 16:50:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-4482781a-ed6d-4e38-8686-1e9e1ee3573d req-0a0ff245-08ba-4367-80c5-79418498e869 service nova] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG nova.network.neutron [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG nova.network.neutron [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:50:27 user nova-compute[74932]: DEBUG nova.compute.manager [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:50:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-76c2a95e-1346-4901-acb3-7fbd02dbe961 req-dffb9467-9b5f-4b7b-aaa0-c4bdd2734371 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-unplugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-76c2a95e-1346-4901-acb3-7fbd02dbe961 req-dffb9467-9b5f-4b7b-aaa0-c4bdd2734371 service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-76c2a95e-1346-4901-acb3-7fbd02dbe961 req-dffb9467-9b5f-4b7b-aaa0-c4bdd2734371 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-76c2a95e-1346-4901-acb3-7fbd02dbe961 req-dffb9467-9b5f-4b7b-aaa0-c4bdd2734371 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:30 user nova-compute[74932]: DEBUG nova.compute.manager [req-76c2a95e-1346-4901-acb3-7fbd02dbe961 req-dffb9467-9b5f-4b7b-aaa0-c4bdd2734371 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-unplugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:50:30 user nova-compute[74932]: WARNING nova.compute.manager [req-76c2a95e-1346-4901-acb3-7fbd02dbe961 req-dffb9467-9b5f-4b7b-aaa0-c4bdd2734371 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-unplugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state active and task_state reboot_started.
Nov 03 16:50:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance shutdown successfully.
Nov 03 16:50:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-230b7898-97b1-4894-bcfd-7bab5856b72c req-cc405b95-dcc4-42ee-ab21-9fed38c1833b service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-230b7898-97b1-4894-bcfd-7bab5856b72c req-cc405b95-dcc4-42ee-ab21-9fed38c1833b service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-230b7898-97b1-4894-bcfd-7bab5856b72c req-cc405b95-dcc4-42ee-ab21-9fed38c1833b service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-230b7898-97b1-4894-bcfd-7bab5856b72c req-cc405b95-dcc4-42ee-ab21-9fed38c1833b service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-230b7898-97b1-4894-bcfd-7bab5856b72c req-cc405b95-dcc4-42ee-ab21-9fed38c1833b service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:50:32 user nova-compute[74932]: WARNING nova.compute.manager [req-230b7898-97b1-4894-bcfd-7bab5856b72c req-cc405b95-dcc4-42ee-ab21-9fed38c1833b service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state active and task_state reboot_started.
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:50:34 user nova-compute[74932]: WARNING nova.compute.manager [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state active and task_state reboot_started.
Nov 03 16:50:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:50:34 user nova-compute[74932]: WARNING nova.compute.manager [req-7e3120c4-37b9-4519-a3be-86e078e937e2 req-fced8577-ad7d-4832-a7dd-0ac5c2ca2a10 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state active and task_state reboot_started.
Nov 03 16:50:34 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance running successfully.
Nov 03 16:50:34 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance soft rebooted successfully.
Nov 03 16:50:34 user nova-compute[74932]: DEBUG nova.compute.manager [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:50:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-afa74558-668c-45b5-8395-a0bc9691a918 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.381s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:44 user nova-compute[74932]: INFO nova.compute.manager [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Terminating instance
Nov 03 16:50:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5d5d1e-65c3-44f2-8b8a-7ec993e8e3d3 req-3e984263-d793-476d-86b3-23aaa08822e5 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-unplugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5d5d1e-65c3-44f2-8b8a-7ec993e8e3d3 req-3e984263-d793-476d-86b3-23aaa08822e5 service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5d5d1e-65c3-44f2-8b8a-7ec993e8e3d3 req-3e984263-d793-476d-86b3-23aaa08822e5 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cf5d5d1e-65c3-44f2-8b8a-7ec993e8e3d3 req-3e984263-d793-476d-86b3-23aaa08822e5 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5d5d1e-65c3-44f2-8b8a-7ec993e8e3d3 req-3e984263-d793-476d-86b3-23aaa08822e5 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-unplugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:50:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-cf5d5d1e-65c3-44f2-8b8a-7ec993e8e3d3 req-3e984263-d793-476d-86b3-23aaa08822e5 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-unplugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:50:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Instance destroyed successfully.
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.objects.instance [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'resources' on Instance uuid 36b59795-c633-412e-92f4-280e6daeec54 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-681209233',display_name='tempest-ServerActionsTestOtherA-server-681209233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-681209233',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-udx1o824',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=36b59795-c633-412e-92f4-280e6daeec54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "address": "fa:16:3e:cd:fd:a3", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2df0959-c8", "ovs_interfaceid": "a2df0959-c89f-418d-85b2-1b858d7aca5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_vif [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2df0959-c8, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=330b38e2-bc8d-4e13-b797-433a26979790) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:45 user nova-compute[74932]: INFO os_vif [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:fd:a3,bridge_name='br-int',has_traffic_filtering=True,id=a2df0959-c89f-418d-85b2-1b858d7aca5d,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2df0959-c8')
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBtYagPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:50:45 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da868d-6d88-4351-b2bd-350c9864976e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:50:45 user nova-compute[74932]: No targets found.
Nov 03 16:50:45 user nova-compute[74932]: iSNS:
Nov 03 16:50:45 user nova-compute[74932]: No targets found.
Nov 03 16:50:45 user nova-compute[74932]: STATIC:
Nov 03 16:50:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb
Nov 03 16:50:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:50:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:50:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:50:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:50:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:50:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2
Nov 03 16:50:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:50:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:50:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b
Nov 03 16:50:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:50:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:50:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83
Nov 03 16:50:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:50:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:50:45 user nova-compute[74932]: FIRMWARE:
Nov 03 16:50:45 user nova-compute[74932]: No targets found.
Nov 03 16:50:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:50:45 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:50:45 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb255081-0f5c-4eff-bac2-a5a1285635ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ebfa12-b635-419b-94b6-57b7e753b635]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:50:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:50:45 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:50:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64249fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ddf0f-90b7-458f-8007-1e6aaead85f4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0845d4-87d4-4986-8607-86de161fde40]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5c4f64-1985-4158-99f5-e3d72b789c8b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e833b0-d60c-4378-a4ab-0fb18c6118c4]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7393f7aa-ec22-469a-bb54-497e61e75e27]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c68de-bc27-4d56-af24-dcd56c2202d9]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260]
Nov 03 16:50:45 user nova-compute[74932]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2, portal: 172.16.0.220,3260] successful.
Nov 03 16:50:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67345509-4a46-4c21-be0b-50f501f1ede2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e99eda-1f63-4804-a1c4-808bd52f1ea7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] <== disconnect_volume: return (307ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:50:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Deleting instance files /opt/stack/data/nova/instances/36b59795-c633-412e-92f4-280e6daeec54_del
Nov 03 16:50:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Deletion of /opt/stack/data/nova/instances/36b59795-c633-412e-92f4-280e6daeec54_del complete
Nov 03 16:50:45 user nova-compute[74932]: INFO nova.compute.manager [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 03 16:50:45 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:50:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:50:46 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:50:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-042fb4f8-8364-483e-af83-dc7767e8aeee req-c1cbaefc-8bd8-41b1-81aa-902bfc51d7be service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-deleted-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:46 user nova-compute[74932]: INFO nova.compute.manager [req-042fb4f8-8364-483e-af83-dc7767e8aeee req-c1cbaefc-8bd8-41b1-81aa-902bfc51d7be service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Neutron deleted interface a2df0959-c89f-418d-85b2-1b858d7aca5d; detaching it from the instance and deleting it from the info cache
Nov 03 16:50:46 user nova-compute[74932]: DEBUG nova.network.neutron [req-042fb4f8-8364-483e-af83-dc7767e8aeee req-c1cbaefc-8bd8-41b1-81aa-902bfc51d7be service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:50:46 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Took 0.79 seconds to deallocate network for instance.
Nov 03 16:50:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-042fb4f8-8364-483e-af83-dc7767e8aeee req-c1cbaefc-8bd8-41b1-81aa-902bfc51d7be service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Detach interface failed, port_id=a2df0959-c89f-418d-85b2-1b858d7aca5d, reason: Instance 36b59795-c633-412e-92f4-280e6daeec54 could not be found. {{(pid=74932) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-f5947345-6884-4739-a3ff-38c9d70df019 req-4a5a460d-a951-450f-836d-b959ffe55831 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f5947345-6884-4739-a3ff-38c9d70df019 req-4a5a460d-a951-450f-836d-b959ffe55831 service nova] Acquiring lock "36b59795-c633-412e-92f4-280e6daeec54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f5947345-6884-4739-a3ff-38c9d70df019 req-4a5a460d-a951-450f-836d-b959ffe55831 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f5947345-6884-4739-a3ff-38c9d70df019 req-4a5a460d-a951-450f-836d-b959ffe55831 service nova] Lock "36b59795-c633-412e-92f4-280e6daeec54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-f5947345-6884-4739-a3ff-38c9d70df019 req-4a5a460d-a951-450f-836d-b959ffe55831 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] No waiting events found dispatching network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:50:47 user nova-compute[74932]: WARNING nova.compute.manager [req-f5947345-6884-4739-a3ff-38c9d70df019 req-4a5a460d-a951-450f-836d-b959ffe55831 service nova] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Received unexpected event network-vif-plugged-a2df0959-c89f-418d-85b2-1b858d7aca5d for instance with vm_state active and task_state deleting.
Nov 03 16:50:47 user nova-compute[74932]: INFO nova.compute.manager [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Took 1.23 seconds to detach 1 volumes for instance.
Nov 03 16:50:47 user nova-compute[74932]: DEBUG nova.compute.manager [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 36b59795-c633-412e-92f4-280e6daeec54] Deleting volume: 67345509-4a46-4c21-be0b-50f501f1ede2 {{(pid=74932) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:50:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:50:48 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:50:48 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:50:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:48 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Deleted allocations for instance 36b59795-c633-412e-92f4-280e6daeec54
Nov 03 16:50:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-94a64838-f5ff-4d22-957a-eb316054aba2 tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "36b59795-c633-412e-92f4-280e6daeec54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.780s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:50:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:50 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:55 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:50:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:50:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:50:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-changed-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG nova.compute.manager [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Refreshing instance network info cache due to event network-changed-56715109-0229-49da-913e-8e5b7849e715. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] Acquiring lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] Acquired lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Refreshing network info cache for port 56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updated VIF entry in instance network info cache for port 56715109-0229-49da-913e-8e5b7849e715. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG nova.network.neutron [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updating instance_info_cache with network_info: [{"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:51:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-320fb665-61f5-4cc8-8554-6bea02869c42 req-34a364d0-69ee-4dbf-a46f-15f32a0ae2e6 service nova] Releasing lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:51:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:51:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:04 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:07 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:09 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:51:11 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8191MB free_disk=24.751449584960938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 0d0016ac-ccd0-45b7-936b-ff0da827760b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance f92a2cae-8a28-47b6-965f-17d8e7952287 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 75f63ea9-9367-4609-a446-c064e491dee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d4d93b47-184d-4639-a7cf-955ab0c2c017 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:51:11 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:51:12 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:51:12 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:51:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:51:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e97b3397-6202-4174-97fe-4639ad2168db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:51:14 user nova-compute[74932]: INFO nova.compute.claims [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Claim successful on node user
Nov 03 16:51:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:51:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:51:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:51:15 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:51:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:51:15 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:51:15 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:51:15 user nova-compute[74932]: INFO nova.virt.block_device [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Booting with volume snapshot 9a687fdf-4486-4d16-a29e-8425e6a887da at /dev/vda
Nov 03 16:51:15 user nova-compute[74932]: DEBUG nova.policy [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd7108d051f4052882dc2855457da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111f571583f844359234fa4760d45a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:51:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:15 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:16 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Successfully created port: ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Successfully updated port: ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquired lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-changed-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Refreshing instance network info cache due to event network-changed-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] Acquiring lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updating instance_info_cache with network_info: [{"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Releasing lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Instance network_info: |[{"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] Acquired lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Refreshing network info cache for port ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updated VIF entry in instance network info cache for port ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG nova.network.neutron [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updating instance_info_cache with network_info: [{"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:51:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-21066270-a621-4547-b538-ee52c64ffaa5 req-abc51e5e-5507-46b5-9a76-3d473b73c419 service nova] Releasing lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:51:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG os_brick.utils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb42c2f-b164-4b8c-a9f5-220d8bc88fd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c7d2fe-e5d7-44a9-9e92-d90c75057ff6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e85824-fa83-401e-935c-3a561acd6b75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5177a8e3-64b4-4b6e-a0cb-09a6bb53cc54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:51:20 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:51:20 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7611599-7358-47ee-b5fc-dd2741885136]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG os_brick.utils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:51:20 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updating existing volume attachment record: ae9fc159-db6d-4ee2-a9ff-74c316c7b3f8 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:51:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:30 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:40 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:51:41 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Creating image(s)
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Ensure instance console log exists: /opt/stack/data/nova/instances/e97b3397-6202-4174-97fe-4639ad2168db/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Start _get_guest_xml network_info=[{"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T16:51:02Z,direct_url=<?>,disk_format='qcow2',id=7159bde5-ebaf-404d-a52d-4b43d4a8471a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1354750499',owner='111f571583f844359234fa4760d45a35',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T16:51:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvBxCSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e97b3397-6202-4174-97fe-4639ad2168db', 'attached_at': '', 'detached_at': '', 'volume_id': '97c9c49e-17b6-47d7-8151-c5626b6fe1d7', 'serial': '97c9c49e-17b6-47d7-8151-c5626b6fe1d7'}, 'attachment_id': 'ae9fc159-db6d-4ee2-a9ff-74c316c7b3f8', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:51:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:51:41 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T16:51:02Z,direct_url=<?>,disk_format='qcow2',id=7159bde5-ebaf-404d-a52d-4b43d4a8471a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1354750499',owner='111f571583f844359234fa4760d45a35',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T16:51:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvBxCSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:51:41 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:51:41 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:51:41 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e88f69-1b2b-4d0a-99f3-1de6be27087d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:51:41 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec634a6-3166-4af8-bfb8-932687b25697]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7] added
Nov 03 16:51:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db68fb-2502-4286-a28c-db2ee4d679dc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c80524-9a4e-4ecc-b4e7-f42565ad023d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtvBxCSK {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtvBxCSK" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efa2a05-8dd7-4af3-9ce6-6c6787cbef71]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtvBxCSK'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a694c39-afcf-4e47-b5d2-ed02f81f4907]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09fa67e-69d3-482f-9cac-950289b48027]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7256a8-0899-4b2b-8d15-170e142873b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260]
Nov 03 16:51:41 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260] successful.
Nov 03 16:51:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ef85c-b90b-4098-a01c-6d695d623458]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ba191-0fed-4d45-8abb-363f468c0344]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:51:41 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a88fbc-00d5-4b7f-8718-1a8a3ed7ba36]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:51:41 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvBxCSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26139633662636366', 'path': '/dev/sdd'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139633662636366', 'path': '/dev/sdd'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121457343',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121457343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-121457343',id=41,image_ref='7159bde5-ebaf-404d-a52d-4b43d4a8471a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnHADQcJ6g0tc3bok+J9iaI2EI1EhEbqXEFunJeyUfmIsqD/DfFr+bQmf/TllR1rQNkir7esHpqLte73DuU2GXPwgUIHNgLZSyXjqinPy5j2ciaulnjDu3u8CKYe2UygA==',key_name='tempest-keypair-1231189945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-2huz91fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1760430654',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd7108d051f4052882dc2855457da38',uuid=e97b3397-6202-4174-97fe-4639ad2168db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.objects.instance [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'pci_devices' on Instance uuid e97b3397-6202-4174-97fe-4639ad2168db {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:51:42 user nova-compute[74932]:   <uuid>e97b3397-6202-4174-97fe-4639ad2168db</uuid>
Nov 03 16:51:42 user nova-compute[74932]:   <name>instance-00000029</name>
Nov 03 16:51:42 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:51:42 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:51:42 user nova-compute[74932]:   <metadata>
Nov 03 16:51:42 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:51:42 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:51:42 user nova-compute[74932]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-121457343</nova:name>
Nov 03 16:51:42 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:51:41</nova:creationTime>
Nov 03 16:51:42 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:51:42 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:51:42 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:51:42 user nova-compute[74932]:       <nova:owner>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:user uuid="9cd7108d051f4052882dc2855457da38">tempest-TestVolumeBootPattern-1760430654-project-member</nova:user>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:project uuid="111f571583f844359234fa4760d45a35">tempest-TestVolumeBootPattern-1760430654</nova:project>
Nov 03 16:51:42 user nova-compute[74932]:       </nova:owner>
Nov 03 16:51:42 user nova-compute[74932]:       <nova:root type="image" uuid="7159bde5-ebaf-404d-a52d-4b43d4a8471a"/>
Nov 03 16:51:42 user nova-compute[74932]:       <nova:ports>
Nov 03 16:51:42 user nova-compute[74932]:         <nova:port uuid="ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e">
Nov 03 16:51:42 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 16:51:42 user nova-compute[74932]:         </nova:port>
Nov 03 16:51:42 user nova-compute[74932]:       </nova:ports>
Nov 03 16:51:42 user nova-compute[74932]:     </nova:instance>
Nov 03 16:51:42 user nova-compute[74932]:   </metadata>
Nov 03 16:51:42 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:51:42 user nova-compute[74932]:     <system>
Nov 03 16:51:42 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:51:42 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:51:42 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:51:42 user nova-compute[74932]:       <entry name="serial">e97b3397-6202-4174-97fe-4639ad2168db</entry>
Nov 03 16:51:42 user nova-compute[74932]:       <entry name="uuid">e97b3397-6202-4174-97fe-4639ad2168db</entry>
Nov 03 16:51:42 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:51:42 user nova-compute[74932]:     </system>
Nov 03 16:51:42 user nova-compute[74932]:   </sysinfo>
Nov 03 16:51:42 user nova-compute[74932]:   <os>
Nov 03 16:51:42 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:51:42 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:51:42 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:51:42 user nova-compute[74932]:   </os>
Nov 03 16:51:42 user nova-compute[74932]:   <features>
Nov 03 16:51:42 user nova-compute[74932]:     <acpi/>
Nov 03 16:51:42 user nova-compute[74932]:     <apic/>
Nov 03 16:51:42 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:51:42 user nova-compute[74932]:   </features>
Nov 03 16:51:42 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:51:42 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:51:42 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:51:42 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:51:42 user nova-compute[74932]:   </clock>
Nov 03 16:51:42 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:51:42 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:51:42 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:51:42 user nova-compute[74932]:   </cpu>
Nov 03 16:51:42 user nova-compute[74932]:   <devices>
Nov 03 16:51:42 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:51:42 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:51:42 user nova-compute[74932]:       <source dev="/dev/sdd"/>
Nov 03 16:51:42 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:51:42 user nova-compute[74932]:       <serial>97c9c49e-17b6-47d7-8151-c5626b6fe1d7</serial>
Nov 03 16:51:42 user nova-compute[74932]:     </disk>
Nov 03 16:51:42 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:51:42 user nova-compute[74932]:       <mac address="fa:16:3e:df:52:e3"/>
Nov 03 16:51:42 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:51:42 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:51:42 user nova-compute[74932]:       <target dev="tapad4d9f6e-f8"/>
Nov 03 16:51:42 user nova-compute[74932]:     </interface>
Nov 03 16:51:42 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:51:42 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/e97b3397-6202-4174-97fe-4639ad2168db/console.log" append="off"/>
Nov 03 16:51:42 user nova-compute[74932]:     </serial>
Nov 03 16:51:42 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:51:42 user nova-compute[74932]:     <video>
Nov 03 16:51:42 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:51:42 user nova-compute[74932]:     </video>
Nov 03 16:51:42 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:51:42 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:51:42 user nova-compute[74932]:     </rng>
Nov 03 16:51:42 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:51:42 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:51:42 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:51:42 user nova-compute[74932]:     </memballoon>
Nov 03 16:51:42 user nova-compute[74932]:   </devices>
Nov 03 16:51:42 user nova-compute[74932]: </domain>
Nov 03 16:51:42 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121457343',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121457343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-121457343',id=41,image_ref='7159bde5-ebaf-404d-a52d-4b43d4a8471a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnHADQcJ6g0tc3bok+J9iaI2EI1EhEbqXEFunJeyUfmIsqD/DfFr+bQmf/TllR1rQNkir7esHpqLte73DuU2GXPwgUIHNgLZSyXjqinPy5j2ciaulnjDu3u8CKYe2UygA==',key_name='tempest-keypair-1231189945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-2huz91fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1760430654',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd7108d051f4052882dc2855457da38',uuid=e97b3397-6202-4174-97fe-4639ad2168db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG os_vif [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db5a5729-b6bb-54cb-87dc-947b0fad90a5', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad4d9f6e-f8, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad4d9f6e-f8, col_values=(('qos', UUID('a8086b56-d499-455e-b947-9e41b0c4b10c')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad4d9f6e-f8, col_values=(('external_ids', {'iface-id': 'ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:52:e3', 'vm-uuid': 'e97b3397-6202-4174-97fe-4639ad2168db'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:42 user nova-compute[74932]: INFO os_vif [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8')
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:51:42 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No VIF found with MAC fa:16:3e:df:52:e3, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:44 user nova-compute[74932]: INFO nova.compute.manager [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Terminating instance
Nov 03 16:51:44 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-e0eb5572-c614-498a-9b04-d3e8f7a48890 req-7d98a238-f93a-4ca6-9eb3-11a44b0f831b service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e0eb5572-c614-498a-9b04-d3e8f7a48890 req-7d98a238-f93a-4ca6-9eb3-11a44b0f831b service nova] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e0eb5572-c614-498a-9b04-d3e8f7a48890 req-7d98a238-f93a-4ca6-9eb3-11a44b0f831b service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e0eb5572-c614-498a-9b04-d3e8f7a48890 req-7d98a238-f93a-4ca6-9eb3-11a44b0f831b service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-e0eb5572-c614-498a-9b04-d3e8f7a48890 req-7d98a238-f93a-4ca6-9eb3-11a44b0f831b service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] No waiting events found dispatching network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:51:44 user nova-compute[74932]: WARNING nova.compute.manager [req-e0eb5572-c614-498a-9b04-d3e8f7a48890 req-7d98a238-f93a-4ca6-9eb3-11a44b0f831b service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received unexpected event network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e for instance with vm_state building and task_state spawning.
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-f445d4b8-c018-45c5-9e34-e0c5c0ddaff3 req-4e48a346-1d70-4fea-afe8-2834586dc017 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f445d4b8-c018-45c5-9e34-e0c5c0ddaff3 req-4e48a346-1d70-4fea-afe8-2834586dc017 service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f445d4b8-c018-45c5-9e34-e0c5c0ddaff3 req-4e48a346-1d70-4fea-afe8-2834586dc017 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f445d4b8-c018-45c5-9e34-e0c5c0ddaff3 req-4e48a346-1d70-4fea-afe8-2834586dc017 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-f445d4b8-c018-45c5-9e34-e0c5c0ddaff3 req-4e48a346-1d70-4fea-afe8-2834586dc017 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG nova.compute.manager [req-f445d4b8-c018-45c5-9e34-e0c5c0ddaff3 req-4e48a346-1d70-4fea-afe8-2834586dc017 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-unplugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:51:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Instance destroyed successfully.
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'resources' on Instance uuid f92a2cae-8a28-47b6-965f-17d8e7952287 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-261612924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-261612924',id=38,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:48:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-f1vwdf0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:49:58Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=f92a2cae-8a28-47b6-965f-17d8e7952287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "594aaaa2-8eca-45bc-942e-6d20701efef9", "address": "fa:16:3e:fd:82:34", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap594aaaa2-8e", "ovs_interfaceid": "594aaaa2-8eca-45bc-942e-6d20701efef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_vif [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap594aaaa2-8e, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfe03194-84ba-496c-84a3-7379f9079549) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:45 user nova-compute[74932]: INFO os_vif [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:82:34,bridge_name='br-int',has_traffic_filtering=True,id=594aaaa2-8eca-45bc-942e-6d20701efef9,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap594aaaa2-8e')
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIHOqNCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:51:45 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82fe233-892d-4530-84b3-c508915b6e4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:51:45 user nova-compute[74932]: No targets found.
Nov 03 16:51:45 user nova-compute[74932]: iSNS:
Nov 03 16:51:45 user nova-compute[74932]: No targets found.
Nov 03 16:51:45 user nova-compute[74932]: STATIC:
Nov 03 16:51:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb
Nov 03 16:51:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:51:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:51:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7
Nov 03 16:51:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:51:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:51:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:51:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:51:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:51:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b
Nov 03 16:51:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:51:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:51:45 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83
Nov 03 16:51:45 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:51:45 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:51:45 user nova-compute[74932]: FIRMWARE:
Nov 03 16:51:45 user nova-compute[74932]: No targets found.
Nov 03 16:51:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:51:45 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:51:45 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907ce4c-d1b0-45f1-a9eb-71516083a13b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb50fca3-e054-4de9-98d8-92d9cf922f5e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:51:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:51:45 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:51:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc846c1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b'): ({'sde'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Removing single pathed devices sde {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988493e-eda5-44be-8912-cd03a04d854b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dee6614-1c41-42c0-9190-12f3d7fca3aa]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flushing IO for device /dev/sde {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d046dba3-0cf4-4dc2-b20b-186925cbbd6b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[36baa5a6-522f-4b80-83d2-dcbade15517c]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] SCSI volumes sde have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26366303863393735', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7182ccfc', '/dev/disk/by-id/scsi-1SCST_BIO7182ccfc-cf08c97551e81fe7') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31b407f-d12e-4c15-bb0f-fdec360f1e16]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[902cb913-d17b-418e-b110-e9a0ed5e4ba0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a163166-e20c-4740-a06c-0fc9c4a90b15]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260]
Nov 03 16:51:45 user nova-compute[74932]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b, portal: 172.16.0.220,3260] successful.
Nov 03 16:51:45 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9582e02-80c5-48d0-9e82-07019f1ecf0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e35431-e918-4da7-9859-136516421a91]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== disconnect_volume: return (364ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:51:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Deleting instance files /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287_del
Nov 03 16:51:45 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Deletion of /opt/stack/data/nova/instances/f92a2cae-8a28-47b6-965f-17d8e7952287_del complete
Nov 03 16:51:45 user nova-compute[74932]: INFO nova.compute.manager [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:45 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:45 user nova-compute[74932]: INFO nova.compute.manager [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Terminating instance
Nov 03 16:51:45 user nova-compute[74932]: DEBUG nova.compute.manager [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Took 0.61 seconds to deallocate network for instance.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Instance destroyed successfully.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.objects.instance [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lazy-loading 'resources' on Instance uuid 0d0016ac-ccd0-45b7-936b-ff0da827760b {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-502484495',display_name='tempest-ServerActionsTestOtherA-server-502484495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-502484495',id=20,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP2TjovCN34kNuVzu2fsv26PqNsqGKQJJcFsrIzqmeHpxgtI2EfIk8yIbBzm+4eEkMNYLsnxA01C46n7ieeeXDsviWjHvLZXzq+NeIaUvCdzBa8szd2j9uEo/YC7fxQtA==',key_name='tempest-keypair-807796742',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:31:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a8cbb942aff476ebf7cca3968447573',ramdisk_id='',reservation_id='r-f801r0ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1516695200',owner_user_name='tempest-ServerActionsTestOtherA-1516695200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90fa01b533204995b57b88b0a4aac138',uuid=0d0016ac-ccd0-45b7-936b-ff0da827760b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converting VIF {"id": "0c575c5b-4834-49fc-85bc-19b531842c25", "address": "fa:16:3e:3e:33:ed", "network": {"id": "4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1450551504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a8cbb942aff476ebf7cca3968447573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c575c5b-48", "ovs_interfaceid": "0c575c5b-4834-49fc-85bc-19b531842c25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG os_vif [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c575c5b-48, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=652399e1-3683-4f4f-86cf-42926390ce37) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:46 user nova-compute[74932]: INFO os_vif [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=0c575c5b-4834-49fc-85bc-19b531842c25,network=Network(4ba6eefb-4ca7-4db1-8e4f-3ae20912ea72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c575c5b-48')
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Deleting instance files /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b_del
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Deletion of /opt/stack/data/nova/instances/0d0016ac-ccd0-45b7-936b-ff0da827760b_del complete
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.compute.manager [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] No waiting events found dispatching network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:51:46 user nova-compute[74932]: WARNING nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received unexpected event network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e for instance with vm_state building and task_state spawning.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-vif-unplugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] No waiting events found dispatching network-vif-unplugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-vif-unplugged-0c575c5b-4834-49fc-85bc-19b531842c25 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Acquiring lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] No waiting events found dispatching network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:51:46 user nova-compute[74932]: WARNING nova.compute.manager [req-45f00489-7c4e-4931-bc6b-9550c7b7011c req-57440ff0-01c8-43c2-b9e6-8fa5fa7fdf46 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received unexpected event network-vif-plugged-0c575c5b-4834-49fc-85bc-19b531842c25 for instance with vm_state active and task_state deleting.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Instance spawned successfully.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:51:46 user nova-compute[74932]: INFO nova.compute.manager [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Took 32.32 seconds to build instance.
Nov 03 16:51:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-0a5aaa6d-24e4-4d0e-9ccd-9c96d97a990d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e97b3397-6202-4174-97fe-4639ad2168db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.411s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] Acquiring lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] No waiting events found dispatching network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:51:47 user nova-compute[74932]: WARNING nova.compute.manager [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received unexpected event network-vif-plugged-594aaaa2-8eca-45bc-942e-6d20701efef9 for instance with vm_state active and task_state deleting.
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.compute.manager [req-7328ed7f-d88b-4581-86a7-c8b31d8a1098 req-4452bfc4-c4f3-488d-8aae-891504f2e343 service nova] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Received event network-vif-deleted-594aaaa2-8eca-45bc-942e-6d20701efef9 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:51:47 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Took 0.50 seconds to deallocate network for instance.
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:47 user nova-compute[74932]: INFO nova.compute.manager [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: f92a2cae-8a28-47b6-965f-17d8e7952287] Took 0.91 seconds to detach 1 volumes for instance.
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.020s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:51:47 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Deleted allocations for instance 0d0016ac-ccd0-45b7-936b-ff0da827760b
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-d9160c33-cff9-40ae-b266-6f9d65bf3ccf tempest-ServerActionsTestOtherA-1516695200 tempest-ServerActionsTestOtherA-1516695200-project-member] Lock "0d0016ac-ccd0-45b7-936b-ff0da827760b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.651s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:47 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Deleted allocations for instance f92a2cae-8a28-47b6-965f-17d8e7952287
Nov 03 16:51:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f0c9f9e6-4704-4d8e-966b-ecc915d8989e tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "f92a2cae-8a28-47b6-965f-17d8e7952287" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.311s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:51:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:49 user nova-compute[74932]: DEBUG nova.compute.manager [req-945df20d-1d94-40f3-9c29-a01603f554c4 req-79dd6756-06c2-4023-b5f3-53cbd4e768d1 service nova] [instance: 0d0016ac-ccd0-45b7-936b-ff0da827760b] Received event network-vif-deleted-0c575c5b-4834-49fc-85bc-19b531842c25 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:51:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:51:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:51:57 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:51:59 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid 11fb8f0c-e8fc-4248-a522-582a859fca29 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:52:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updating instance_info_cache with network_info: [{"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:52:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-11fb8f0c-e8fc-4248-a522-582a859fca29" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:52:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:52:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:52:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:52:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:04 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:05 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:52:12 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:52:12 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8291MB free_disk=24.768444061279297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 75f63ea9-9367-4609-a446-c064e491dee8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d4d93b47-184d-4639-a7cf-955ab0c2c017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance e97b3397-6202-4174-97fe-4639ad2168db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:52:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:15 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:16 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing instance network info cache due to event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:52:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:52:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:52:18 user nova-compute[74932]: DEBUG nova.network.neutron [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updated VIF entry in instance network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c737f995-d1d1-4344-8b07-f6c9b2c6d8d8 req-b6dbb066-d872-4b04-b60d-024ff81e7843 service nova] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing instance network info cache due to event network-changed-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] Acquiring lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] Acquired lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Refreshing network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:19 user nova-compute[74932]: INFO nova.compute.manager [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Detaching volume c851d892-86d3-4b19-ab20-7ec392145b83
Nov 03 16:52:19 user nova-compute[74932]: INFO nova.virt.block_device [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Attempting to driver detach volume c851d892-86d3-4b19-ab20-7ec392145b83 from mountpoint /dev/vdb
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Attempting to detach device vdb from instance 75f63ea9-9367-4609-a446-c064e491dee8 from the persistent domain config. {{(pid=74932) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:52:19 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:52:19 user nova-compute[74932]:   <source dev="/dev/sdf"/>
Nov 03 16:52:19 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:52:19 user nova-compute[74932]:   <serial>c851d892-86d3-4b19-ab20-7ec392145b83</serial>
Nov 03 16:52:19 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:52:19 user nova-compute[74932]: </disk>
Nov 03 16:52:19 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:52:19 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully detached device vdb from instance 75f63ea9-9367-4609-a446-c064e491dee8 from the persistent domain config.
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75f63ea9-9367-4609-a446-c064e491dee8 from the live domain config. {{(pid=74932) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 16:52:19 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:52:19 user nova-compute[74932]:   <source dev="/dev/sdf"/>
Nov 03 16:52:19 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:52:19 user nova-compute[74932]:   <serial>c851d892-86d3-4b19-ab20-7ec392145b83</serial>
Nov 03 16:52:19 user nova-compute[74932]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 16:52:19 user nova-compute[74932]: </disk>
Nov 03 16:52:19 user nova-compute[74932]:  {{(pid=74932) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updated VIF entry in instance network info cache for port 7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG nova.network.neutron [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [{"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:52:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1f33feb6-7a4e-4699-ae16-a844b77cd791 req-a76bc566-515e-4d1a-89aa-d57e0d87e08d service nova] Releasing lock "refresh_cache-75f63ea9-9367-4609-a446-c064e491dee8" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:52:20 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 16:52:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:35 user nova-compute[74932]: INFO nova.compute.manager [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Terminating instance
Nov 03 16:52:35 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-af8410de-42ad-49e3-8099-1e0659ebd6bc req-45bc1c1e-f9b7-479a-be37-45c161d28e9b service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-vif-unplugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-af8410de-42ad-49e3-8099-1e0659ebd6bc req-45bc1c1e-f9b7-479a-be37-45c161d28e9b service nova] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-af8410de-42ad-49e3-8099-1e0659ebd6bc req-45bc1c1e-f9b7-479a-be37-45c161d28e9b service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-af8410de-42ad-49e3-8099-1e0659ebd6bc req-45bc1c1e-f9b7-479a-be37-45c161d28e9b service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-af8410de-42ad-49e3-8099-1e0659ebd6bc req-45bc1c1e-f9b7-479a-be37-45c161d28e9b service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] No waiting events found dispatching network-vif-unplugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:52:35 user nova-compute[74932]: DEBUG nova.compute.manager [req-af8410de-42ad-49e3-8099-1e0659ebd6bc req-45bc1c1e-f9b7-479a-be37-45c161d28e9b service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-vif-unplugged-7a3f4ec9-3f53-4611-9234-030908e10cec for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:52:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Instance destroyed successfully.
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'resources' on Instance uuid 995b57a0-17c8-4dc5-bc97-84c0a386bad8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1692367219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1692367219',id=34,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-n43sdmrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:45:09Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=995b57a0-17c8-4dc5-bc97-84c0a386bad8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "7a3f4ec9-3f53-4611-9234-030908e10cec", "address": "fa:16:3e:a3:b0:ef", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3f4ec9-3f", "ovs_interfaceid": "7a3f4ec9-3f53-4611-9234-030908e10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG os_vif [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a3f4ec9-3f, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=136ad874-8c3a-4513-83fb-ff197cdddc88) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:52:36 user nova-compute[74932]: INFO os_vif [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b0:ef,bridge_name='br-int',has_traffic_filtering=True,id=7a3f4ec9-3f53-4611-9234-030908e10cec,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3f4ec9-3f')
Nov 03 16:52:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Deleting instance files /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8_del
Nov 03 16:52:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Deletion of /opt/stack/data/nova/instances/995b57a0-17c8-4dc5-bc97-84c0a386bad8_del complete
Nov 03 16:52:36 user nova-compute[74932]: INFO nova.compute.manager [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 03 16:52:36 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:52:36 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Took 0.47 seconds to deallocate network for instance.
Nov 03 16:52:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:52:36 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:52:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:37 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Deleted allocations for instance 995b57a0-17c8-4dc5-bc97-84c0a386bad8
Nov 03 16:52:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c7ef0b9c-512c-4de5-859e-0e3948b9ca26 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] Acquiring lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:37 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] Lock "995b57a0-17c8-4dc5-bc97-84c0a386bad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] No waiting events found dispatching network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:52:37 user nova-compute[74932]: WARNING nova.compute.manager [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received unexpected event network-vif-plugged-7a3f4ec9-3f53-4611-9234-030908e10cec for instance with vm_state deleted and task_state None.
Nov 03 16:52:37 user nova-compute[74932]: DEBUG nova.compute.manager [req-1ba662a3-3a73-4276-b234-1bedc53fbebd req-a0ed1a38-54e3-44d7-a1f8-17b8b52762b8 service nova] [instance: 995b57a0-17c8-4dc5-bc97-84c0a386bad8] Received event network-vif-deleted-7a3f4ec9-3f53-4611-9234-030908e10cec {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:39 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:40 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75f63ea9-9367-4609-a446-c064e491dee8 is timed out.
Nov 03 16:52:40 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully detached device vdb from instance 75f63ea9-9367-4609-a446-c064e491dee8 from the live domain config.
Nov 03 16:52:40 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRtakAdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:52:40 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd26878b-3f07-4339-ad7c-7bb60a3d7c7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:52:40 user nova-compute[74932]: No targets found.
Nov 03 16:52:40 user nova-compute[74932]: iSNS:
Nov 03 16:52:40 user nova-compute[74932]: No targets found.
Nov 03 16:52:40 user nova-compute[74932]: STATIC:
Nov 03 16:52:40 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb
Nov 03 16:52:40 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:52:40 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:52:40 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7
Nov 03 16:52:40 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:52:40 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:52:40 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:52:40 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:52:40 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:52:40 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83
Nov 03 16:52:40 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:52:40 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:52:40 user nova-compute[74932]: FIRMWARE:
Nov 03 16:52:40 user nova-compute[74932]: No targets found.
Nov 03 16:52:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:52:40 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:52:40 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[be232517-e7c1-41a1-8da6-7c03ab9075e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[12241298-ddc1-425f-9506-4f637fbb444a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:52:40 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:52:40 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:52:40 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:52:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:52:40 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:52:40 user nova-compute[74932]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 (non-flash)
Nov 03 16:52:40 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:52:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64177c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83'): ({'sdf'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Removing single pathed devices sdf {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722d083-9dc5-495d-ab8e-be8b7dcb49fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663318c-03bc-4c13-8460-5c8106fa1443]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Flushing IO for device /dev/sdf {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fe29b3-da22-4d24-a265-13bfe35816e6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdcf93d-6ad0-412f-9417-a07de94627dc]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] SCSI volumes sdf have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da914b-4518-4046-9f1d-6b692899fdd6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[da66bb7c-eca6-4e6d-adb3-e13e6c73c671]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260]
Nov 03 16:52:40 user nova-compute[74932]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83, portal: 172.16.0.220,3260] successful.
Nov 03 16:52:40 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c851d892-86d3-4b19-ab20-7ec392145b83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc68d3d-d0ec-45c6-9475-75dc95a3e688]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] <== disconnect_volume: return (325ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:52:40 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:52:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:41 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'flavor' on Instance uuid 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:52:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a9ca4729-7f73-4dfe-b725-4edaf8120476 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.095s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:49 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:49 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:52:50 user nova-compute[74932]: INFO nova.compute.claims [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Claim successful on node user
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.network.neutron [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:52:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.policy [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63644b6ff64d4196b889c21dcb78aa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d1eeebf4164638b090201dc42f041e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:52:50 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Creating image(s)
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "/opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "/opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "/opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:50 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.196s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.193s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk 1073741824" returned: 0 in 0.052s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG nova.network.neutron [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Successfully created port: 5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Cannot resize image /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Ensure instance console log exists: /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:51 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Successfully updated port: 5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquired lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received event network-changed-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.compute.manager [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Refreshing instance network info cache due to event network-changed-5ed86a01-51fe-4f43-85c4-ef845d090cca. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] Acquiring lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updating instance_info_cache with network_info: [{"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Releasing lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Instance network_info: |[{"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] Acquired lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Refreshing network info cache for port 5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Start _get_guest_xml network_info=[{"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:52:52 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:52:52 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2053488377',display_name='tempest-AttachVolumeTestJSON-server-2053488377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2053488377',id=42,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsvp4iQJOM0sx8fjFD3KOnLmzHoLcNHGhung/PJ8mMHFGW3goMuxe95aLJSx0/MG3qFKI5xQsc3L5GxweadjX8YTVTnCP0Hfqze9mV4DozAaksKheXhoYjcM+Ld41lK5w==',key_name='tempest-keypair-931145892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d1eeebf4164638b090201dc42f041e',ramdisk_id='',reservation_id='r-rqq15rbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-389143718',owner_user_name='tempest-AttachVolumeTestJSON-389143718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63644b6ff64d4196b889c21dcb78aa8c',uuid=5184a2c9-d049-4737-8088-3bfd33db22a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Converting VIF {"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=5ed86a01-51fe-4f43-85c4-ef845d090cca,network=Network(638ae53c-cd08-4d40-be74-720621295baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86a01-51') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.objects.instance [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lazy-loading 'pci_devices' on Instance uuid 5184a2c9-d049-4737-8088-3bfd33db22a9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:52:52 user nova-compute[74932]:   <uuid>5184a2c9-d049-4737-8088-3bfd33db22a9</uuid>
Nov 03 16:52:52 user nova-compute[74932]:   <name>instance-0000002a</name>
Nov 03 16:52:52 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:52:52 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:52:52 user nova-compute[74932]:   <metadata>
Nov 03 16:52:52 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:52:52 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:52:52 user nova-compute[74932]:       <nova:name>tempest-AttachVolumeTestJSON-server-2053488377</nova:name>
Nov 03 16:52:52 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:52:52</nova:creationTime>
Nov 03 16:52:52 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:52:52 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:52:52 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:52:52 user nova-compute[74932]:       <nova:owner>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:user uuid="63644b6ff64d4196b889c21dcb78aa8c">tempest-AttachVolumeTestJSON-389143718-project-member</nova:user>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:project uuid="04d1eeebf4164638b090201dc42f041e">tempest-AttachVolumeTestJSON-389143718</nova:project>
Nov 03 16:52:52 user nova-compute[74932]:       </nova:owner>
Nov 03 16:52:52 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:52:52 user nova-compute[74932]:       <nova:ports>
Nov 03 16:52:52 user nova-compute[74932]:         <nova:port uuid="5ed86a01-51fe-4f43-85c4-ef845d090cca">
Nov 03 16:52:52 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 16:52:52 user nova-compute[74932]:         </nova:port>
Nov 03 16:52:52 user nova-compute[74932]:       </nova:ports>
Nov 03 16:52:52 user nova-compute[74932]:     </nova:instance>
Nov 03 16:52:52 user nova-compute[74932]:   </metadata>
Nov 03 16:52:52 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:52:52 user nova-compute[74932]:     <system>
Nov 03 16:52:52 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:52:52 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:52:52 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:52:52 user nova-compute[74932]:       <entry name="serial">5184a2c9-d049-4737-8088-3bfd33db22a9</entry>
Nov 03 16:52:52 user nova-compute[74932]:       <entry name="uuid">5184a2c9-d049-4737-8088-3bfd33db22a9</entry>
Nov 03 16:52:52 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:52:52 user nova-compute[74932]:     </system>
Nov 03 16:52:52 user nova-compute[74932]:   </sysinfo>
Nov 03 16:52:52 user nova-compute[74932]:   <os>
Nov 03 16:52:52 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:52:52 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:52:52 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:52:52 user nova-compute[74932]:   </os>
Nov 03 16:52:52 user nova-compute[74932]:   <features>
Nov 03 16:52:52 user nova-compute[74932]:     <acpi/>
Nov 03 16:52:52 user nova-compute[74932]:     <apic/>
Nov 03 16:52:52 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:52:52 user nova-compute[74932]:   </features>
Nov 03 16:52:52 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:52:52 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:52:52 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:52:52 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:52:52 user nova-compute[74932]:   </clock>
Nov 03 16:52:52 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:52:52 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:52:52 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:52:52 user nova-compute[74932]:   </cpu>
Nov 03 16:52:52 user nova-compute[74932]:   <devices>
Nov 03 16:52:52 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:52:52 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:52:52 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk"/>
Nov 03 16:52:52 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:52:52 user nova-compute[74932]:     </disk>
Nov 03 16:52:52 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:52:52 user nova-compute[74932]:       <mac address="fa:16:3e:67:8e:74"/>
Nov 03 16:52:52 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:52:52 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:52:52 user nova-compute[74932]:       <target dev="tap5ed86a01-51"/>
Nov 03 16:52:52 user nova-compute[74932]:     </interface>
Nov 03 16:52:52 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:52:52 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/console.log" append="off"/>
Nov 03 16:52:52 user nova-compute[74932]:     </serial>
Nov 03 16:52:52 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:52:52 user nova-compute[74932]:     <video>
Nov 03 16:52:52 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:52:52 user nova-compute[74932]:     </video>
Nov 03 16:52:52 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:52:52 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:52:52 user nova-compute[74932]:     </rng>
Nov 03 16:52:52 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:52:52 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:52:52 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:52:52 user nova-compute[74932]:     </memballoon>
Nov 03 16:52:52 user nova-compute[74932]:   </devices>
Nov 03 16:52:52 user nova-compute[74932]: </domain>
Nov 03 16:52:52 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2053488377',display_name='tempest-AttachVolumeTestJSON-server-2053488377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2053488377',id=42,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsvp4iQJOM0sx8fjFD3KOnLmzHoLcNHGhung/PJ8mMHFGW3goMuxe95aLJSx0/MG3qFKI5xQsc3L5GxweadjX8YTVTnCP0Hfqze9mV4DozAaksKheXhoYjcM+Ld41lK5w==',key_name='tempest-keypair-931145892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04d1eeebf4164638b090201dc42f041e',ramdisk_id='',reservation_id='r-rqq15rbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-389143718',owner_user_name='tempest-AttachVolumeTestJSON-389143718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63644b6ff64d4196b889c21dcb78aa8c',uuid=5184a2c9-d049-4737-8088-3bfd33db22a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Converting VIF {"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=5ed86a01-51fe-4f43-85c4-ef845d090cca,network=Network(638ae53c-cd08-4d40-be74-720621295baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86a01-51') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG os_vif [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=5ed86a01-51fe-4f43-85c4-ef845d090cca,network=Network(638ae53c-cd08-4d40-be74-720621295baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86a01-51') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad77bcb9-444d-5840-9d79-9e0671b892a7', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed86a01-51, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ed86a01-51, col_values=(('qos', UUID('2d4b7213-f0b3-4251-81ad-02ee03162cba')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ed86a01-51, col_values=(('external_ids', {'iface-id': '5ed86a01-51fe-4f43-85c4-ef845d090cca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:8e:74', 'vm-uuid': '5184a2c9-d049-4737-8088-3bfd33db22a9'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:52 user nova-compute[74932]: INFO os_vif [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:8e:74,bridge_name='br-int',has_traffic_filtering=True,id=5ed86a01-51fe-4f43-85c4-ef845d090cca,network=Network(638ae53c-cd08-4d40-be74-720621295baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86a01-51')
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] No VIF found with MAC fa:16:3e:67:8e:74, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updated VIF entry in instance network info cache for port 5ed86a01-51fe-4f43-85c4-ef845d090cca. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG nova.network.neutron [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updating instance_info_cache with network_info: [{"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:52:52 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-0480606e-6b01-48af-b0f8-d51a5940335f req-2af716f8-fe02-44fa-9a30-2c0d54d3c040 service nova] Releasing lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:52:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-88c2bad0-c521-4d72-bfa2-840cf49b5751 req-7a91fcfb-b589-499d-ad11-34eac005beae service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received event network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-88c2bad0-c521-4d72-bfa2-840cf49b5751 req-7a91fcfb-b589-499d-ad11-34eac005beae service nova] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-88c2bad0-c521-4d72-bfa2-840cf49b5751 req-7a91fcfb-b589-499d-ad11-34eac005beae service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-88c2bad0-c521-4d72-bfa2-840cf49b5751 req-7a91fcfb-b589-499d-ad11-34eac005beae service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG nova.compute.manager [req-88c2bad0-c521-4d72-bfa2-840cf49b5751 req-7a91fcfb-b589-499d-ad11-34eac005beae service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] No waiting events found dispatching network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:52:54 user nova-compute[74932]: WARNING nova.compute.manager [req-88c2bad0-c521-4d72-bfa2-840cf49b5751 req-7a91fcfb-b589-499d-ad11-34eac005beae service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received unexpected event network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca for instance with vm_state building and task_state spawning.
Nov 03 16:52:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:52:56 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Instance spawned successfully.
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-d8dba721-733f-4725-ad2d-9c64ab24687a req-abce8347-6118-49d0-96f9-3ba65ecb0daa service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received event network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d8dba721-733f-4725-ad2d-9c64ab24687a req-abce8347-6118-49d0-96f9-3ba65ecb0daa service nova] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d8dba721-733f-4725-ad2d-9c64ab24687a req-abce8347-6118-49d0-96f9-3ba65ecb0daa service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-d8dba721-733f-4725-ad2d-9c64ab24687a req-abce8347-6118-49d0-96f9-3ba65ecb0daa service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.compute.manager [req-d8dba721-733f-4725-ad2d-9c64ab24687a req-abce8347-6118-49d0-96f9-3ba65ecb0daa service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] No waiting events found dispatching network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:52:56 user nova-compute[74932]: WARNING nova.compute.manager [req-d8dba721-733f-4725-ad2d-9c64ab24687a req-abce8347-6118-49d0-96f9-3ba65ecb0daa service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received unexpected event network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca for instance with vm_state building and task_state spawning.
Nov 03 16:52:56 user nova-compute[74932]: INFO nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 03 16:52:56 user nova-compute[74932]: DEBUG nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:52:56 user nova-compute[74932]: INFO nova.compute.manager [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Took 6.17 seconds to build instance.
Nov 03 16:52:56 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-72b2f515-e727-404d-8f8a-6f69cc1b2e8e tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.415s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:52:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:52:58 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:59 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:52:59 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:52:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:52:59 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:52:59 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:53:00 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [{"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:53:00 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-4fda841d-fbf5-441b-906c-9cc3b12e6ac1" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:53:00 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:53:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-changed-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG nova.compute.manager [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Refreshing instance network info cache due to event network-changed-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] Acquiring lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] Acquired lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Refreshing network info cache for port ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updated VIF entry in instance network info cache for port ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG nova.network.neutron [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updating instance_info_cache with network_info: [{"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e4722412-4773-4469-8cdc-d9a66f6d2dba req-03a9806b-33f8-4f43-b373-3192e4f61de7 service nova] Releasing lock "refresh_cache-e97b3397-6202-4174-97fe-4639ad2168db" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e97b3397-6202-4174-97fe-4639ad2168db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:05 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:05 user nova-compute[74932]: INFO nova.compute.manager [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Terminating instance
Nov 03 16:53:05 user nova-compute[74932]: DEBUG nova.compute.manager [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-e80e14d5-ee36-4135-8b17-f4624314bf70 req-9e91a558-3a3d-475d-8a50-e2e246e7f75f service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-vif-unplugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e80e14d5-ee36-4135-8b17-f4624314bf70 req-9e91a558-3a3d-475d-8a50-e2e246e7f75f service nova] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e80e14d5-ee36-4135-8b17-f4624314bf70 req-9e91a558-3a3d-475d-8a50-e2e246e7f75f service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e80e14d5-ee36-4135-8b17-f4624314bf70 req-9e91a558-3a3d-475d-8a50-e2e246e7f75f service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-e80e14d5-ee36-4135-8b17-f4624314bf70 req-9e91a558-3a3d-475d-8a50-e2e246e7f75f service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] No waiting events found dispatching network-vif-unplugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.compute.manager [req-e80e14d5-ee36-4135-8b17-f4624314bf70 req-9e91a558-3a3d-475d-8a50-e2e246e7f75f service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-vif-unplugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:06 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Instance destroyed successfully.
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.objects.instance [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'resources' on Instance uuid e97b3397-6202-4174-97fe-4639ad2168db {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121457343',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121457343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-121457343',id=41,image_ref='7159bde5-ebaf-404d-a52d-4b43d4a8471a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnHADQcJ6g0tc3bok+J9iaI2EI1EhEbqXEFunJeyUfmIsqD/DfFr+bQmf/TllR1rQNkir7esHpqLte73DuU2GXPwgUIHNgLZSyXjqinPy5j2ciaulnjDu3u8CKYe2UygA==',key_name='tempest-keypair-1231189945',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:51:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-2huz91fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1760430654',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd7108d051f4052882dc2855457da38',uuid=e97b3397-6202-4174-97fe-4639ad2168db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "address": "fa:16:3e:df:52:e3", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4d9f6e-f8", "ovs_interfaceid": "ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_vif [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad4d9f6e-f8, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8086b56-d499-455e-b947-9e41b0c4b10c) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:53:06 user nova-compute[74932]: INFO os_vif [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4d9f6e-f8')
Nov 03 16:53:06 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtvBxCSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:53:06 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7033d6f-9065-4b2f-8a48-0d466d1867dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:53:06 user nova-compute[74932]: No targets found.
Nov 03 16:53:06 user nova-compute[74932]: iSNS:
Nov 03 16:53:06 user nova-compute[74932]: No targets found.
Nov 03 16:53:06 user nova-compute[74932]: STATIC:
Nov 03 16:53:06 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb
Nov 03 16:53:06 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:53:06 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:53:06 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7
Nov 03 16:53:06 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:53:06 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:53:06 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:53:06 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:53:06 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:53:06 user nova-compute[74932]: FIRMWARE:
Nov 03 16:53:06 user nova-compute[74932]: No targets found.
Nov 03 16:53:06 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:53:06 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:53:06 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[27437eee-a914-4f4d-9dda-4d2a2e5b3c6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf6fe00-34e7-4717-a992-fd8d7be84b6b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:53:06 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:53:06 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:53:06 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:53:06 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:53:06 user nova-compute[74932]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 (non-flash)
Nov 03 16:53:06 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64157910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7'): ({'sdd'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Removing single pathed devices sdd {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8bfbcd-b28c-4312-92d7-856b549287c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e9f96-180b-4186-afb4-d03dce2a022f]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flushing IO for device /dev/sdd {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ff0580-b403-4ad6-b88a-11510a0a2246]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d005bd-4a4a-4973-92a5-4c51cbeb5226]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] SCSI volumes sdd have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa85e1575-a9c6bccf1c82c7e6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a85e1575', '/dev/disk/by-id/scsi-26139633662636366') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 16:53:06 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd12b9-87e6-4017-bdad-401dfd2ac89f]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9b637b-cfb3-4d39-ac5d-241233076c8c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa2ac82-bc19-4a91-a014-ce8ddfd26e8a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260]
Nov 03 16:53:07 user nova-compute[74932]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7, portal: 172.16.0.220,3260] successful.
Nov 03 16:53:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c9c49e-17b6-47d7-8151-c5626b6fe1d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38d18a-c12f-4536-b591-e00821552180]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== disconnect_volume: return (363ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:53:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Deleting instance files /opt/stack/data/nova/instances/e97b3397-6202-4174-97fe-4639ad2168db_del
Nov 03 16:53:07 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Deletion of /opt/stack/data/nova/instances/e97b3397-6202-4174-97fe-4639ad2168db_del complete
Nov 03 16:53:07 user nova-compute[74932]: INFO nova.compute.manager [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 03 16:53:07 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e97b3397-6202-4174-97fe-4639ad2168db] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:53:07 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:53:07 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Took 0.66 seconds to deallocate network for instance.
Nov 03 16:53:07 user nova-compute[74932]: DEBUG nova.compute.manager [req-6d27199c-90b4-46d1-838d-449d6cf707b9 req-314c710d-7459-4420-be61-662c1979adc8 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-vif-deleted-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-7038d7bb-d880-4583-93a1-3dde38e5d469 req-21174ae9-e7a1-4374-84d1-da33df32dda0 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received event network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7038d7bb-d880-4583-93a1-3dde38e5d469 req-21174ae9-e7a1-4374-84d1-da33df32dda0 service nova] Acquiring lock "e97b3397-6202-4174-97fe-4639ad2168db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7038d7bb-d880-4583-93a1-3dde38e5d469 req-21174ae9-e7a1-4374-84d1-da33df32dda0 service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-7038d7bb-d880-4583-93a1-3dde38e5d469 req-21174ae9-e7a1-4374-84d1-da33df32dda0 service nova] Lock "e97b3397-6202-4174-97fe-4639ad2168db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG nova.compute.manager [req-7038d7bb-d880-4583-93a1-3dde38e5d469 req-21174ae9-e7a1-4374-84d1-da33df32dda0 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] No waiting events found dispatching network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:53:08 user nova-compute[74932]: WARNING nova.compute.manager [req-7038d7bb-d880-4583-93a1-3dde38e5d469 req-21174ae9-e7a1-4374-84d1-da33df32dda0 service nova] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Received unexpected event network-vif-plugged-ad4d9f6e-f83c-45f2-8790-1c6ae6fc885e for instance with vm_state active and task_state deleting.
Nov 03 16:53:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:08 user nova-compute[74932]: INFO nova.compute.manager [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Took 0.93 seconds to detach 1 volumes for instance.
Nov 03 16:53:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: e97b3397-6202-4174-97fe-4639ad2168db] Deleting volume: 97c9c49e-17b6-47d7-8151-c5626b6fe1d7 {{(pid=74932) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:08 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:09 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:53:09 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:53:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:09 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Deleted allocations for instance e97b3397-6202-4174-97fe-4639ad2168db
Nov 03 16:53:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-242ae584-b1de-4f94-b0cd-d9df9d8aaed4 tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "e97b3397-6202-4174-97fe-4639ad2168db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.369s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:53:10 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:12 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:53:12 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=24.863780975341797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 75f63ea9-9367-4609-a446-c064e491dee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d4d93b47-184d-4639-a7cf-955ab0c2c017 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5184a2c9-d049-4737-8088-3bfd33db22a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:53:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:17 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:17 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:53:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:21 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:22 user nova-compute[74932]: INFO nova.compute.manager [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Terminating instance
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-f4257438-9456-4ba8-ace3-4ea9793dc8bd req-30528bf2-b125-46c8-bcb3-ec1f7d9e2631 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-unplugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f4257438-9456-4ba8-ace3-4ea9793dc8bd req-30528bf2-b125-46c8-bcb3-ec1f7d9e2631 service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f4257438-9456-4ba8-ace3-4ea9793dc8bd req-30528bf2-b125-46c8-bcb3-ec1f7d9e2631 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f4257438-9456-4ba8-ace3-4ea9793dc8bd req-30528bf2-b125-46c8-bcb3-ec1f7d9e2631 service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-f4257438-9456-4ba8-ace3-4ea9793dc8bd req-30528bf2-b125-46c8-bcb3-ec1f7d9e2631 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-unplugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.compute.manager [req-f4257438-9456-4ba8-ace3-4ea9793dc8bd req-30528bf2-b125-46c8-bcb3-ec1f7d9e2631 service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-unplugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Instance destroyed successfully.
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.objects.instance [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lazy-loading 'resources' on Instance uuid 75f63ea9-9367-4609-a446-c064e491dee8 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-408745725',display_name='tempest-TestMinimumBasicScenario-server-408745725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-408745725',id=39,image_ref='33ef3325-c19c-4110-9b33-639f29d001de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNww2dnct6WCy+tYVa3s7aQJibRMKUY7gkrHuifYadCfiK2oaE+OwXk8MmpOZOTtxcWTloeloBOOAS9e5/vuJa7EkoKEeEXmllsMqHGzoKmmMvN4iHbF1HysGfWnjinWQ==',key_name='tempest-TestMinimumBasicScenario-1359277928',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:48:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84af8fad5724ccc9e09836bcebb1ada',ramdisk_id='',reservation_id='r-zpfltuo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='33ef3325-c19c-4110-9b33-639f29d001de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62950615',owner_user_name='tempest-TestMinimumBasicScenario-62950615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:50:35Z,user_data=None,user_id='fd1db8beca33482681f7d7b701d762f6',uuid=75f63ea9-9367-4609-a446-c064e491dee8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converting VIF {"id": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "address": "fa:16:3e:88:8b:5c", "network": {"id": "236d2af1-140b-4a50-b122-8bad07c54106", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-119459590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84af8fad5724ccc9e09836bcebb1ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb740b9-15", "ovs_interfaceid": "7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG os_vif [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fb740b9-15, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6ea115a-cac2-440f-808c-95cad5fb595b) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:53:22 user nova-compute[74932]: INFO os_vif [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:8b:5c,bridge_name='br-int',has_traffic_filtering=True,id=7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c,network=Network(236d2af1-140b-4a50-b122-8bad07c54106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb740b9-15')
Nov 03 16:53:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Deleting instance files /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8_del
Nov 03 16:53:22 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Deletion of /opt/stack/data/nova/instances/75f63ea9-9367-4609-a446-c064e491dee8_del complete
Nov 03 16:53:22 user nova-compute[74932]: INFO nova.compute.manager [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 03 16:53:22 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:53:22 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:53:23 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:53:23 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Took 0.46 seconds to deallocate network for instance.
Nov 03 16:53:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:23 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:53:23 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:53:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:23 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Deleted allocations for instance 75f63ea9-9367-4609-a446-c064e491dee8
Nov 03 16:53:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-c12705e1-eeb2-4981-b192-b8613207ed26 tempest-TestMinimumBasicScenario-62950615 tempest-TestMinimumBasicScenario-62950615-project-member] Lock "75f63ea9-9367-4609-a446-c064e491dee8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.689s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] Acquiring lock "75f63ea9-9367-4609-a446-c064e491dee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] Lock "75f63ea9-9367-4609-a446-c064e491dee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] No waiting events found dispatching network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:53:24 user nova-compute[74932]: WARNING nova.compute.manager [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received unexpected event network-vif-plugged-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c for instance with vm_state deleted and task_state None.
Nov 03 16:53:24 user nova-compute[74932]: DEBUG nova.compute.manager [req-794e6fab-ace8-4ad4-805c-583fa6930d96 req-2b7de907-83bc-483a-a7dc-39a91d4af27e service nova] [instance: 75f63ea9-9367-4609-a446-c064e491dee8] Received event network-vif-deleted-7fb740b9-1542-4ef9-8ba0-68f0fc9f3c9c {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:25 user nova-compute[74932]: INFO nova.compute.manager [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Terminating instance
Nov 03 16:53:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:53:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-unplugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] Acquiring lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.compute.manager [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] No waiting events found dispatching network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:53:26 user nova-compute[74932]: WARNING nova.compute.manager [req-95b20f4b-b1d1-4e6b-b5bf-0ac2aa5d981e req-7b1eb4b2-fd42-4736-bfcc-28ceb6c60b5e service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received unexpected event network-vif-plugged-dfb466d0-aa2b-4bb3-b028-740be8874e2b for instance with vm_state active and task_state deleting.
Nov 03 16:53:26 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Instance destroyed successfully.
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.objects.instance [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'resources' on Instance uuid 4fda841d-fbf5-441b-906c-9cc3b12e6ac1 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1372592949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1372592949',id=30,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-t7m0i33j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:41:26Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=4fda841d-fbf5-441b-906c-9cc3b12e6ac1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "address": "fa:16:3e:c5:77:45", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb466d0-aa", "ovs_interfaceid": "dfb466d0-aa2b-4bb3-b028-740be8874e2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_vif [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfb466d0-aa, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8ca22f3-e949-412c-8dfb-c9054aad0751) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:26 user nova-compute[74932]: INFO os_vif [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:77:45,bridge_name='br-int',has_traffic_filtering=True,id=dfb466d0-aa2b-4bb3-b028-740be8874e2b,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb466d0-aa')
Nov 03 16:53:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdKtRYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:53:26 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe979ecb-d708-432b-bd10-2c5c379770eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:53:26 user nova-compute[74932]: No targets found.
Nov 03 16:53:26 user nova-compute[74932]: iSNS:
Nov 03 16:53:26 user nova-compute[74932]: No targets found.
Nov 03 16:53:26 user nova-compute[74932]: STATIC:
Nov 03 16:53:26 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb
Nov 03 16:53:26 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:53:26 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:53:26 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562
Nov 03 16:53:26 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:53:26 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:53:26 user nova-compute[74932]: FIRMWARE:
Nov 03 16:53:26 user nova-compute[74932]: No targets found.
Nov 03 16:53:26 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:53:26 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:53:26 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d5eb97-34bb-4060-b62d-f8bac8b6ef94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2c96b8-8fdb-4bc4-bfe3-2d722aba117f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:53:26 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:53:26 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 (non-flash)
Nov 03 16:53:26 user nova-compute[74932]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:53:26 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64157880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562'): ({'sdb'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Removing single pathed devices sdb {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[176cbac8-032f-473f-ab8b-acfc82500813]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c053a16-c83a-4ec5-b617-16c262708e85]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Flushing IO for device /dev/sdb {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[721ddd40-970d-4718-b421-9f0856938f13]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b289d93-c150-45ea-9077-ba3ec2c5a5ed]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] SCSI volumes sdb have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eaaae4-de40-416b-ad17-f7e8119bcc8d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d509761f-9554-4ceb-820b-448294a7b9df]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260]
Nov 03 16:53:26 user nova-compute[74932]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562, portal: 172.16.0.220,3260] successful.
Nov 03 16:53:26 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5206edfc-e197-4e82-ae3a-772043b5e562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cadeb4a-6ae8-4bb1-be67-c25611738058]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:53:26 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:53:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:53:27 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] <== disconnect_volume: return (299ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:53:27 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:53:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Deleting instance files /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1_del
Nov 03 16:53:27 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Deletion of /opt/stack/data/nova/instances/4fda841d-fbf5-441b-906c-9cc3b12e6ac1_del complete
Nov 03 16:53:27 user nova-compute[74932]: INFO nova.compute.manager [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 03 16:53:27 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:53:27 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:53:27 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:53:27 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:53:27 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Took 0.46 seconds to deallocate network for instance.
Nov 03 16:53:28 user nova-compute[74932]: INFO nova.compute.manager [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Took 0.85 seconds to detach 1 volumes for instance.
Nov 03 16:53:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:53:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:53:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:28 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:53:28 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:53:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:28 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Deleted allocations for instance 4fda841d-fbf5-441b-906c-9cc3b12e6ac1
Nov 03 16:53:28 user nova-compute[74932]: DEBUG nova.compute.manager [req-136e779c-2562-4093-8289-135ed32f4e36 req-ac43bfee-1c45-4b45-ab90-e3433f183d73 service nova] [instance: 4fda841d-fbf5-441b-906c-9cc3b12e6ac1] Received event network-vif-deleted-dfb466d0-aa2b-4bb3-b028-740be8874e2b {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:53:28 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-902f8b3d-fe1d-41be-a3ba-fcf833f0e948 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "4fda841d-fbf5-441b-906c-9cc3b12e6ac1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:53:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:53:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:53:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:53:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:53:36 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:41 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:51 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:53:56 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:54:01 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:54:02 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updating instance_info_cache with network_info: [{"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:54:02 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-d4d93b47-184d-4639-a7cf-955ab0c2c017" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:54:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:54:05 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:05 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:54:06 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:07 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:10 user nova-compute[74932]: INFO nova.compute.manager [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Terminating instance
Nov 03 16:54:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ece06c38-1226-40fc-96e3-fe35070d67d4 req-985fccb4-0c0c-4deb-baf0-b36b9241886c service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-unplugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ece06c38-1226-40fc-96e3-fe35070d67d4 req-985fccb4-0c0c-4deb-baf0-b36b9241886c service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ece06c38-1226-40fc-96e3-fe35070d67d4 req-985fccb4-0c0c-4deb-baf0-b36b9241886c service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ece06c38-1226-40fc-96e3-fe35070d67d4 req-985fccb4-0c0c-4deb-baf0-b36b9241886c service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ece06c38-1226-40fc-96e3-fe35070d67d4 req-985fccb4-0c0c-4deb-baf0-b36b9241886c service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-unplugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ece06c38-1226-40fc-96e3-fe35070d67d4 req-985fccb4-0c0c-4deb-baf0-b36b9241886c service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-unplugged-56715109-0229-49da-913e-8e5b7849e715 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:11 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Instance destroyed successfully.
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.objects.instance [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'resources' on Instance uuid d4d93b47-184d-4639-a7cf-955ab0c2c017 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-421782136',display_name='tempest-TestVolumeBootPattern-volume-backed-server-421782136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-421782136',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+NxEzxfGlsZo5MQ+9PpK7X/tJQ6Jg/fzXxhZHJ7tkcXs0LMG8JhUWGmRmcFXEhi4WMm45+MR8xVKWrjHzE/sYEitOI85O98YJjgc5gwnMiBfCoZIYCgS/L6LiykTkFBw==',key_name='tempest-keypair-1346928800',keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-djx9lxvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd7108d051f4052882dc2855457da38',uuid=d4d93b47-184d-4639-a7cf-955ab0c2c017,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "56715109-0229-49da-913e-8e5b7849e715", "address": "fa:16:3e:08:bd:82", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56715109-02", "ovs_interfaceid": "56715109-0229-49da-913e-8e5b7849e715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_vif [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56715109-02, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92a258fd-ed7c-45df-8b2e-3c1e4780855b) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:11 user nova-compute[74932]: INFO os_vif [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:bd:82,bridge_name='br-int',has_traffic_filtering=True,id=56715109-0229-49da-913e-8e5b7849e715,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56715109-02')
Nov 03 16:54:11 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] calling os-brick to detach iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, {'target_iqn': 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdDfSyLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:54:11 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[22540820-fea3-441c-91f4-bf37669371d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 16:54:11 user nova-compute[74932]: No targets found.
Nov 03 16:54:11 user nova-compute[74932]: iSNS:
Nov 03 16:54:11 user nova-compute[74932]: No targets found.
Nov 03 16:54:11 user nova-compute[74932]: STATIC:
Nov 03 16:54:11 user nova-compute[74932]: Target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb
Nov 03 16:54:11 user nova-compute[74932]:         Portal: 172.16.0.220:3260,-1
Nov 03 16:54:11 user nova-compute[74932]:                 Iface Name: default
Nov 03 16:54:11 user nova-compute[74932]: FIRMWARE:
Nov 03 16:54:11 user nova-compute[74932]: No targets found.
Nov 03 16:54:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 16:54:11 user nova-compute[74932]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 16:54:11 user nova-compute[74932]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74932) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb', 0)] {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919f1cb-696b-4f84-a671-82b43f565770]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d462b6c-4272-4ba8-be18-f387c23b2ac1]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:54:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb (non-flash)
Nov 03 16:54:11 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6445c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb'): ({'sdc'}, set())}) {{(pid=74932) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Removing single pathed devices sdc {{(pid=74932) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1c693e-0cd6-40d9-a38d-cfce25654098]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e50c11b-bbf1-4a01-882b-12bf6cc626ce]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flushing IO for device /dev/sdc {{(pid=74932) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffcad7-a47e-4c9a-a64f-26438ff103ae]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74932) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 16:54:11 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[80af6682-83e6-489a-8a5e-cd8c18b0d78d]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] SCSI volumes sdc have been removed. {{(pid=74932) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_df2c5f97', '/dev/disk/by-id/scsi-23735656530623966', '/dev/disk/by-id/scsi-1SCST_BIOdf2c5f97-75ee0b9ff7c652f8') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6566454-528b-4d69-85d7-094c07872bab]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb')] {{(pid=74932) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa8748-71be-4fc6-bb9c-ccac3ddb2bcd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a426b662-af6b-4c1e-b6da-7ac48caa8845]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260]
Nov 03 16:54:12 user nova-compute[74932]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb, portal: 172.16.0.220,3260] successful.
Nov 03 16:54:12 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159abfc0-d3de-451a-9792-7589be8c6bfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd8490-e383-4018-ac55-03bbf7374fe4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== disconnect_volume: return (358ms) None {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Disconnected iSCSI Volume {{(pid=74932) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 16:54:12 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Deleting instance files /opt/stack/data/nova/instances/d4d93b47-184d-4639-a7cf-955ab0c2c017_del
Nov 03 16:54:12 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Deletion of /opt/stack/data/nova/instances/d4d93b47-184d-4639-a7cf-955ab0c2c017_del complete
Nov 03 16:54:12 user nova-compute[74932]: INFO nova.compute.manager [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:54:12 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Took 0.70 seconds to deallocate network for instance.
Nov 03 16:54:12 user nova-compute[74932]: DEBUG nova.compute.manager [req-40b8b0fc-8316-4776-904e-100fe33db336 req-492609eb-7106-47e7-866b-4d3d10bfceac service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-deleted-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:12 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:13 user nova-compute[74932]: WARNING nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received unexpected event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 for instance with vm_state active and task_state deleting.
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:13 user nova-compute[74932]: WARNING nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received unexpected event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 for instance with vm_state active and task_state deleting.
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:13 user nova-compute[74932]: WARNING nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received unexpected event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 for instance with vm_state active and task_state deleting.
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-unplugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-unplugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-unplugged-56715109-0229-49da-913e-8e5b7849e715 for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Acquiring lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] No waiting events found dispatching network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:13 user nova-compute[74932]: WARNING nova.compute.manager [req-8b663c87-2ebc-458a-ad94-731e71dabbbd req-b7573b8b-1f0d-470d-a6bb-c6ab864e8ad8 service nova] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Received unexpected event network-vif-plugged-56715109-0229-49da-913e-8e5b7849e715 for instance with vm_state active and task_state deleting.
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:54:13 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:54:13 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=24.927722930908203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:13 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 11fb8f0c-e8fc-4248-a522-582a859fca29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance d4d93b47-184d-4639-a7cf-955ab0c2c017 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5184a2c9-d049-4737-8088-3bfd33db22a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing inventories for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating ProviderTree inventory for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Updating inventory in ProviderTree for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing aggregate associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, aggregates: None {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Refreshing trait associations for resource provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42 {{(pid=74932) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:14 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74932) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 16:54:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:16 user nova-compute[74932]: INFO nova.compute.manager [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Took 3.29 seconds to detach 1 volumes for instance.
Nov 03 16:54:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: d4d93b47-184d-4639-a7cf-955ab0c2c017] Deleting volume: 159abfc0-d3de-451a-9792-7589be8c6bfb {{(pid=74932) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:16 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Deleted allocations for instance d4d93b47-184d-4639-a7cf-955ab0c2c017
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-275b7c44-0a17-44cb-a6f5-fe3e5e9eb77d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "d4d93b47-184d-4639-a7cf-955ab0c2c017" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.764s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:16 user nova-compute[74932]: INFO nova.compute.manager [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Terminating instance
Nov 03 16:54:16 user nova-compute[74932]: DEBUG nova.compute.manager [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Start destroying the instance on the hypervisor. {{(pid=74932) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:16 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc6ce640-e89d-44b9-a6aa-434b93b4f347 req-dc101351-1a0f-48d8-b12c-6141497a5902 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-vif-unplugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc6ce640-e89d-44b9-a6aa-434b93b4f347 req-dc101351-1a0f-48d8-b12c-6141497a5902 service nova] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc6ce640-e89d-44b9-a6aa-434b93b4f347 req-dc101351-1a0f-48d8-b12c-6141497a5902 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-bc6ce640-e89d-44b9-a6aa-434b93b4f347 req-dc101351-1a0f-48d8-b12c-6141497a5902 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc6ce640-e89d-44b9-a6aa-434b93b4f347 req-dc101351-1a0f-48d8-b12c-6141497a5902 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] No waiting events found dispatching network-vif-unplugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.compute.manager [req-bc6ce640-e89d-44b9-a6aa-434b93b4f347 req-dc101351-1a0f-48d8-b12c-6141497a5902 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-vif-unplugged-46ad95a9-cffc-4068-bd45-866e2c328c5e for instance with task_state deleting. {{(pid=74932) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 16:54:17 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Instance destroyed successfully.
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.objects.instance [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lazy-loading 'resources' on Instance uuid 11fb8f0c-e8fc-4248-a522-582a859fca29 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:34:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-755999671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-755999671',id=25,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T16:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f123f628d784aaaadba9dea7eb71ce2',ramdisk_id='',reservation_id='r-lyjhd6u0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T16:36:35Z,user_data=None,user_id='f2fbcaa1d5bb4249b127dcdc0875517a',uuid=11fb8f0c-e8fc-4248-a522-582a859fca29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converting VIF {"id": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "address": "fa:16:3e:74:0a:20", "network": {"id": "486f5373-9ae4-450f-b9b4-79a11ea314c2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-338074606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f123f628d784aaaadba9dea7eb71ce2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46ad95a9-cf", "ovs_interfaceid": "46ad95a9-cffc-4068-bd45-866e2c328c5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG os_vif [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf') {{(pid=74932) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46ad95a9-cf, bridge=br-int, if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Cleaning up deleted instances {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd5db0cc-6f57-4afe-b0fd-6ac30d514257) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:17 user nova-compute[74932]: INFO os_vif [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=46ad95a9-cffc-4068-bd45-866e2c328c5e,network=Network(486f5373-9ae4-450f-b9b4-79a11ea314c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46ad95a9-cf')
Nov 03 16:54:17 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Deleting instance files /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29_del
Nov 03 16:54:17 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Deletion of /opt/stack/data/nova/instances/11fb8f0c-e8fc-4248-a522-582a859fca29_del complete
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] There are 0 instances to clean {{(pid=74932) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 16:54:17 user nova-compute[74932]: INFO nova.compute.manager [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 16:54:17 user nova-compute[74932]: DEBUG oslo.service.loopingcall [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74932) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.compute.manager [-] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Deallocating network for instance {{(pid=74932) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 16:54:17 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] deallocate_for_instance() {{(pid=74932) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG nova.network.neutron [-] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Updating instance_info_cache with network_info: [] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:54:18 user nova-compute[74932]: INFO nova.compute.manager [-] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Took 0.40 seconds to deallocate network for instance.
Nov 03 16:54:18 user nova-compute[74932]: DEBUG nova.compute.manager [req-0611c746-c2b8-4b6e-ac01-1dd6a81dd4ff req-e4d53e5d-5794-41f2-8f76-d4a926f61945 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-vif-deleted-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:18 user nova-compute[74932]: INFO nova.scheduler.client.report [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Deleted allocations for instance 11fb8f0c-e8fc-4248-a522-582a859fca29
Nov 03 16:54:18 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-cdfc507a-e2b2-481e-a254-51c9f8bc2bd8 tempest-ServerBootFromVolumeStableRescueTest-2083155834 tempest-ServerBootFromVolumeStableRescueTest-2083155834-project-member] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.664s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-9adc95fe-2c9c-4a5f-affd-c8af038229b8 req-2946d69e-6da5-4923-85e4-bdda3616b058 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received event network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9adc95fe-2c9c-4a5f-affd-c8af038229b8 req-2946d69e-6da5-4923-85e4-bdda3616b058 service nova] Acquiring lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9adc95fe-2c9c-4a5f-affd-c8af038229b8 req-2946d69e-6da5-4923-85e4-bdda3616b058 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:19 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-9adc95fe-2c9c-4a5f-affd-c8af038229b8 req-2946d69e-6da5-4923-85e4-bdda3616b058 service nova] Lock "11fb8f0c-e8fc-4248-a522-582a859fca29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:19 user nova-compute[74932]: DEBUG nova.compute.manager [req-9adc95fe-2c9c-4a5f-affd-c8af038229b8 req-2946d69e-6da5-4923-85e4-bdda3616b058 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] No waiting events found dispatching network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:54:19 user nova-compute[74932]: WARNING nova.compute.manager [req-9adc95fe-2c9c-4a5f-affd-c8af038229b8 req-2946d69e-6da5-4923-85e4-bdda3616b058 service nova] [instance: 11fb8f0c-e8fc-4248-a522-582a859fca29] Received unexpected event network-vif-plugged-46ad95a9-cffc-4068-bd45-866e2c328c5e for instance with vm_state deleted and task_state None.
Nov 03 16:54:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:28 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:54:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received event network-changed-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:54:41 user nova-compute[74932]: DEBUG nova.compute.manager [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Refreshing instance network info cache due to event network-changed-5ed86a01-51fe-4f43-85c4-ef845d090cca. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:54:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] Acquiring lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:54:41 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] Acquired lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:54:41 user nova-compute[74932]: DEBUG nova.network.neutron [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Refreshing network info cache for port 5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:54:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updated VIF entry in instance network info cache for port 5ed86a01-51fe-4f43-85c4-ef845d090cca. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:54:42 user nova-compute[74932]: DEBUG nova.network.neutron [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updating instance_info_cache with network_info: [{"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:54:42 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-986582e0-88ad-4510-8f9b-32c3a6e70cda req-f6f6d68f-7b13-464b-898c-c83dc91bcf8a service nova] Releasing lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:54:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lazy-loading 'flavor' on Instance uuid 5184a2c9-d049-4737-8088-3bfd33db22a9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:54:47 user nova-compute[74932]: INFO nova.compute.manager [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Attaching volume deb16249-56e2-48cb-9775-03c2648e1f62 to /dev/vdb
Nov 03 16:54:47 user nova-compute[74932]: DEBUG os_brick.utils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92dafbc-9141-4267-a137-b96aba0aa1f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a996cb-7b3a-4a43-bca2-361579f0cc1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:47 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a0c954-a8a6-41cc-8dfc-9354e1b1da83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984d79a-0455-45ac-9280-e9cf58fcfe4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:54:48 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:54:48 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e603d2b-6048-4a5b-b170-36e56effa2e0]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG os_brick.utils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updating existing volume attachment record: 965f3028-2d88-4353-b69d-9552cd3f07dd {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:54:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:52 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:54:57 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:54:58 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:00 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:55:02 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Didn't find any instances for network info cache update. {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 16:55:02 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjktFLpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:55:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:55:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:55:07 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0b475-eeba-41af-b91d-658cb6cb9912]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:55:07 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6700e2e-0a67-4375-aded-226fcc0a18e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62] added
Nov 03 16:55:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccde374-4216-4742-98dc-d01d8847d0b9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606bd5e-0366-4511-9933-6df720ac8cef]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjktFLpo {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjktFLpo" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[1476c355-0d4d-4622-89d7-bd49ac761755]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjktFLpo'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[67885f78-11e2-4c55-9ff5-e154e3d255da]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[829ec288-b9ad-4ba7-96b0-90aacb92fafc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:55:07 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 16:55:07 user nova-compute[74932]:  {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:55:07 user nova-compute[74932]: WARNING os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 16:55:07 user nova-compute[74932]: 
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa4122f-ed98-4983-84d7-0c9fed107a39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62, portal: 172.16.0.220,3260]
Nov 03 16:55:07 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62, portal: 172.16.0.220,3260] successful.
Nov 03 16:55:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc00ff4-3fa5-4139-89e8-eddfae1e4bdc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47d7738-3a4d-4f32-aab3-1903032a25d2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)
Nov 03 16:55:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)
Nov 03 16:55:07 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf141e9-66ff-41b5-8f88-3e6f046de1eb]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjktFLpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74932) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74932) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 16:55:07 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:55:08 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26261333866366134', 'path': '/dev/sdb'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:55:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261333866366134', 'path': '/dev/sdb'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:55:08 user nova-compute[74932]: DEBUG nova.objects.instance [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lazy-loading 'flavor' on Instance uuid 5184a2c9-d049-4737-8088-3bfd33db22a9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:55:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:08 user nova-compute[74932]: DEBUG nova.virt.libvirt.guest [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 16:55:08 user nova-compute[74932]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:55:08 user nova-compute[74932]:   <source dev="/dev/sdb"/>
Nov 03 16:55:08 user nova-compute[74932]:   <target dev="vdb" bus="virtio"/>
Nov 03 16:55:08 user nova-compute[74932]:   <serial>deb16249-56e2-48cb-9775-03c2648e1f62</serial>
Nov 03 16:55:08 user nova-compute[74932]: </disk>
Nov 03 16:55:08 user nova-compute[74932]:  {{(pid=74932) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] No VIF found with MAC fa:16:3e:67:8e:74, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-e5145729-4d36-4bf0-968e-807028d6d1fe tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.345s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74932) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.objects.instance [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lazy-loading 'flavor' on Instance uuid 5184a2c9-d049-4737-8088-3bfd33db22a9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-fcc0d14e-3f1f-42a2-93a4-356e26c7d73c req-d7063b1d-4a6b-4d3a-bb68-98a4eac00470 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received event network-vif-unplugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fcc0d14e-3f1f-42a2-93a4-356e26c7d73c req-d7063b1d-4a6b-4d3a-bb68-98a4eac00470 service nova] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fcc0d14e-3f1f-42a2-93a4-356e26c7d73c req-d7063b1d-4a6b-4d3a-bb68-98a4eac00470 service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-fcc0d14e-3f1f-42a2-93a4-356e26c7d73c req-d7063b1d-4a6b-4d3a-bb68-98a4eac00470 service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:09 user nova-compute[74932]: DEBUG nova.compute.manager [req-fcc0d14e-3f1f-42a2-93a4-356e26c7d73c req-d7063b1d-4a6b-4d3a-bb68-98a4eac00470 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] No waiting events found dispatching network-vif-unplugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:55:09 user nova-compute[74932]: WARNING nova.compute.manager [req-fcc0d14e-3f1f-42a2-93a4-356e26c7d73c req-d7063b1d-4a6b-4d3a-bb68-98a4eac00470 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received unexpected event network-vif-unplugged-5ed86a01-51fe-4f43-85c4-ef845d090cca for instance with vm_state active and task_state powering-off.
Nov 03 16:55:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:10 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Instance destroyed successfully.
Nov 03 16:55:10 user nova-compute[74932]: DEBUG nova.compute.manager [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:55:10 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-3dc7d73c-4ed2-4ec9-9135-ffc620f9b6be tempest-AttachVolumeTestJSON-389143718 tempest-AttachVolumeTestJSON-389143718-project-member] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.931s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ddcf67b2-5406-4cc1-b1af-2ade66f68cf6 req-350edd9c-b2ea-46bb-b45c-28eb076538f8 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received event network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:55:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ddcf67b2-5406-4cc1-b1af-2ade66f68cf6 req-350edd9c-b2ea-46bb-b45c-28eb076538f8 service nova] Acquiring lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ddcf67b2-5406-4cc1-b1af-2ade66f68cf6 req-350edd9c-b2ea-46bb-b45c-28eb076538f8 service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:11 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ddcf67b2-5406-4cc1-b1af-2ade66f68cf6 req-350edd9c-b2ea-46bb-b45c-28eb076538f8 service nova] Lock "5184a2c9-d049-4737-8088-3bfd33db22a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:11 user nova-compute[74932]: DEBUG nova.compute.manager [req-ddcf67b2-5406-4cc1-b1af-2ade66f68cf6 req-350edd9c-b2ea-46bb-b45c-28eb076538f8 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] No waiting events found dispatching network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:55:11 user nova-compute[74932]: WARNING nova.compute.manager [req-ddcf67b2-5406-4cc1-b1af-2ade66f68cf6 req-350edd9c-b2ea-46bb-b45c-28eb076538f8 service nova] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Received unexpected event network-vif-plugged-5ed86a01-51fe-4f43-85c4-ef845d090cca for instance with vm_state stopped and task_state None.
Nov 03 16:55:12 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:55:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:55:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.041610717773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5184a2c9-d049-4737-8088-3bfd33db22a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:55:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:17 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:18 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:18 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:55:22 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:22 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:22 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:55:23 user nova-compute[74932]: INFO nova.compute.claims [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Claim successful on node user
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:55:23 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.policy [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd7108d051f4052882dc2855457da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111f571583f844359234fa4760d45a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:55:23 user nova-compute[74932]: INFO nova.virt.block_device [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Booting with volume 0e44be1d-acb2-42ee-9dc5-3780bf58b214 at /dev/vda
Nov 03 16:55:23 user nova-compute[74932]: DEBUG os_brick.utils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[275fd4d2-dbd3-473c-b248-a461d64c4a6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a352f9cb9d3a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b877db10-b18a-4b93-a9b8-8a9fffb57a52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1acb5f8-e0d0-4bdf-9810-afc77da4378e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2094972-9c18-4379-a229-d813b7895706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Running cmd (subprocess): nvme version {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] 'nvme version' failed. Not Retrying. {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] nvme not present on system {{(pid=74932) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 16:55:23 user nova-compute[74932]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 16:55:23 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b51507-172b-4116-b52e-aa05bd521288]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74932) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.lightos [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] LIGHTOS: no hostnqn found. {{(pid=74932) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG os_brick.utils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a352f9cb9d3a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:55:23 user nova-compute[74932]: DEBUG nova.virt.block_device [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Updating existing volume attachment record: 512de4bf-d092-40d6-ae9c-c9cf15791819 {{(pid=74932) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 16:55:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Successfully created port: cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:55:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Successfully updated port: cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:55:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "refresh_cache-fcd6d439-3bed-4d51-8ed1-639a7bc8289e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:55:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquired lock "refresh_cache-fcd6d439-3bed-4d51-8ed1-639a7bc8289e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:55:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Received event network-changed-cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Refreshing instance network info cache due to event network-changed-cfb1a695-a7b3-4024-af79-4527b4310e24. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] Acquiring lock "refresh_cache-fcd6d439-3bed-4d51-8ed1-639a7bc8289e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Updating instance_info_cache with network_info: [{"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Releasing lock "refresh_cache-fcd6d439-3bed-4d51-8ed1-639a7bc8289e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Instance network_info: |[{"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] Acquired lock "refresh_cache-fcd6d439-3bed-4d51-8ed1-639a7bc8289e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Refreshing network info cache for port cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Updated VIF entry in instance network info cache for port cfb1a695-a7b3-4024-af79-4527b4310e24. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG nova.network.neutron [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Updating instance_info_cache with network_info: [{"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:55:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-89c5db15-94f3-4b72-bf2f-ac52f04d21cf req-f1938534-21ae-4055-bffd-2b836e51851f service nova] Releasing lock "refresh_cache-fcd6d439-3bed-4d51-8ed1-639a7bc8289e" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:55:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:55:43 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Creating image(s)
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Did not create local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Ensure instance console log exists: /opt/stack/data/nova/instances/fcd6d439-3bed-4d51-8ed1-639a7bc8289e/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Start _get_guest_xml network_info=[{"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPvxMmyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcd6d439-3bed-4d51-8ed1-639a7bc8289e', 'attached_at': '', 'detached_at': '', 'volume_id': '0e44be1d-acb2-42ee-9dc5-3780bf58b214', 'serial': '0e44be1d-acb2-42ee-9dc5-3780bf58b214'}, 'attachment_id': '512de4bf-d092-40d6-ae9c-c9cf15791819', 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:55:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:55:43 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Calling os-brick to attach iSCSI Volume {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc843f65f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPvxMmyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 16:55:43 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:55:43 user nova-compute[74932]: WARNING os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 16:55:43 user nova-compute[74932]: INFO os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a0726-5c83-4f5c-a3f8-59b4b259ad78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 16:55:43 user nova-compute[74932]:  {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[db819aab-b4ed-4480-ac7a-7cd697f530c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214] added
Nov 03 16:55:43 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e799e2b-44b7-44c0-a84d-16aa4f14fc21]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a4747-6e91-4423-9838-99843339e3a2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPvxMmyU {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPvxMmyU" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1b8cd-9110-4c7c-9f82-1b2321e54de7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPvxMmyU'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b4243-c18b-4e25-9604-c46b60fe346e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d3f628-8ecd-417d-a2af-03209908cef3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)
Nov 03 16:55:43 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)
Nov 03 16:55:43 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[881175d2-f276-48c7-8ff1-52394485fa48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214, portal: 172.16.0.220,3260]
Nov 03 16:55:43 user nova-compute[74932]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214, portal: 172.16.0.220,3260] successful.
Nov 03 16:55:43 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba84ce4-2d65-4016-a162-4ca1d4fadb26]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74932) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b907d-3ffa-4bdb-97aa-7022851234d4]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)
Nov 03 16:55:43 user nova-compute[74932]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 (non-flash)
Nov 03 16:55:43 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb16249-56e2-48cb-9775-03c2648e1f62 (non-flash)
Nov 03 16:55:43 user nova-compute[74932]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214 (non-flash)
Nov 03 16:55:43 user nova-compute[74932]:  stderr= {{(pid=74932) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to 172.16.0.220:3260 {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74932) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74932) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c3dccd-d7c5-477e-b0bc-61bf014db337]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 16:55:43 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG os_brick.initiator.linuxscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74932) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0e44be1d-acb2-42ee-9dc5-3780bf58b214', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPvxMmyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74932) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.base [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23130623462653130', 'path': '/dev/sdc'} {{(pid=74932) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130623462653130', 'path': '/dev/sdc'} {{(pid=74932) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-234309380',display_name='tempest-TestVolumeBootPattern-server-234309380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-234309380',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjpIygrwXsQtXEx5M/nejvqdmCMLjTtHvyE4dkxZr79UFxsJ1i6dGdP0DAGEnLHz9Sf6HfZNOlG77NseviojrwNMe2rG0qj9KiCdo3HXWV9+spiCFnuzyFlhS9ChkaM0w==',key_name='tempest-TestVolumeBootPattern-231566126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-t4fy1rnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:55:23Z,user_data=None,user_id='9cd7108d051f4052882dc2855457da38',uuid=fcd6d439-3bed-4d51-8ed1-639a7bc8289e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f3:26,bridge_name='br-int',has_traffic_filtering=True,id=cfb1a695-a7b3-4024-af79-4527b4310e24,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb1a695-a7') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.objects.instance [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd6d439-3bed-4d51-8ed1-639a7bc8289e {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:55:44 user nova-compute[74932]:   <uuid>fcd6d439-3bed-4d51-8ed1-639a7bc8289e</uuid>
Nov 03 16:55:44 user nova-compute[74932]:   <name>instance-0000002b</name>
Nov 03 16:55:44 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:55:44 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:55:44 user nova-compute[74932]:   <metadata>
Nov 03 16:55:44 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:55:44 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:55:44 user nova-compute[74932]:       <nova:name>tempest-TestVolumeBootPattern-server-234309380</nova:name>
Nov 03 16:55:44 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:55:43</nova:creationTime>
Nov 03 16:55:44 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:55:44 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:55:44 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:55:44 user nova-compute[74932]:       <nova:owner>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:user uuid="9cd7108d051f4052882dc2855457da38">tempest-TestVolumeBootPattern-1760430654-project-member</nova:user>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:project uuid="111f571583f844359234fa4760d45a35">tempest-TestVolumeBootPattern-1760430654</nova:project>
Nov 03 16:55:44 user nova-compute[74932]:       </nova:owner>
Nov 03 16:55:44 user nova-compute[74932]:       <nova:ports>
Nov 03 16:55:44 user nova-compute[74932]:         <nova:port uuid="cfb1a695-a7b3-4024-af79-4527b4310e24">
Nov 03 16:55:44 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 16:55:44 user nova-compute[74932]:         </nova:port>
Nov 03 16:55:44 user nova-compute[74932]:       </nova:ports>
Nov 03 16:55:44 user nova-compute[74932]:     </nova:instance>
Nov 03 16:55:44 user nova-compute[74932]:   </metadata>
Nov 03 16:55:44 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:55:44 user nova-compute[74932]:     <system>
Nov 03 16:55:44 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:55:44 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:55:44 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:55:44 user nova-compute[74932]:       <entry name="serial">fcd6d439-3bed-4d51-8ed1-639a7bc8289e</entry>
Nov 03 16:55:44 user nova-compute[74932]:       <entry name="uuid">fcd6d439-3bed-4d51-8ed1-639a7bc8289e</entry>
Nov 03 16:55:44 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:55:44 user nova-compute[74932]:     </system>
Nov 03 16:55:44 user nova-compute[74932]:   </sysinfo>
Nov 03 16:55:44 user nova-compute[74932]:   <os>
Nov 03 16:55:44 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:55:44 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:55:44 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:55:44 user nova-compute[74932]:   </os>
Nov 03 16:55:44 user nova-compute[74932]:   <features>
Nov 03 16:55:44 user nova-compute[74932]:     <acpi/>
Nov 03 16:55:44 user nova-compute[74932]:     <apic/>
Nov 03 16:55:44 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:55:44 user nova-compute[74932]:   </features>
Nov 03 16:55:44 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:55:44 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:55:44 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:55:44 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:55:44 user nova-compute[74932]:   </clock>
Nov 03 16:55:44 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:55:44 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:55:44 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:55:44 user nova-compute[74932]:   </cpu>
Nov 03 16:55:44 user nova-compute[74932]:   <devices>
Nov 03 16:55:44 user nova-compute[74932]:     <disk type="block" device="disk">
Nov 03 16:55:44 user nova-compute[74932]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 16:55:44 user nova-compute[74932]:       <source dev="/dev/sdc"/>
Nov 03 16:55:44 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:55:44 user nova-compute[74932]:       <serial>0e44be1d-acb2-42ee-9dc5-3780bf58b214</serial>
Nov 03 16:55:44 user nova-compute[74932]:     </disk>
Nov 03 16:55:44 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:55:44 user nova-compute[74932]:       <mac address="fa:16:3e:68:f3:26"/>
Nov 03 16:55:44 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:55:44 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:55:44 user nova-compute[74932]:       <target dev="tapcfb1a695-a7"/>
Nov 03 16:55:44 user nova-compute[74932]:     </interface>
Nov 03 16:55:44 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:55:44 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/fcd6d439-3bed-4d51-8ed1-639a7bc8289e/console.log" append="off"/>
Nov 03 16:55:44 user nova-compute[74932]:     </serial>
Nov 03 16:55:44 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:55:44 user nova-compute[74932]:     <video>
Nov 03 16:55:44 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:55:44 user nova-compute[74932]:     </video>
Nov 03 16:55:44 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:55:44 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:55:44 user nova-compute[74932]:     </rng>
Nov 03 16:55:44 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:55:44 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:55:44 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:55:44 user nova-compute[74932]:     </memballoon>
Nov 03 16:55:44 user nova-compute[74932]:   </devices>
Nov 03 16:55:44 user nova-compute[74932]: </domain>
Nov 03 16:55:44 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-234309380',display_name='tempest-TestVolumeBootPattern-server-234309380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-234309380',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjpIygrwXsQtXEx5M/nejvqdmCMLjTtHvyE4dkxZr79UFxsJ1i6dGdP0DAGEnLHz9Sf6HfZNOlG77NseviojrwNMe2rG0qj9KiCdo3HXWV9+spiCFnuzyFlhS9ChkaM0w==',key_name='tempest-TestVolumeBootPattern-231566126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111f571583f844359234fa4760d45a35',ramdisk_id='',reservation_id='r-t4fy1rnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1760430654',owner_user_name='tempest-TestVolumeBootPattern-1760430654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:55:23Z,user_data=None,user_id='9cd7108d051f4052882dc2855457da38',uuid=fcd6d439-3bed-4d51-8ed1-639a7bc8289e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converting VIF {"id": "cfb1a695-a7b3-4024-af79-4527b4310e24", "address": "fa:16:3e:68:f3:26", "network": {"id": "56bffba7-8cb5-43e2-a092-7fb36da6d43a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-550160852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111f571583f844359234fa4760d45a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb1a695-a7", "ovs_interfaceid": "cfb1a695-a7b3-4024-af79-4527b4310e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f3:26,bridge_name='br-int',has_traffic_filtering=True,id=cfb1a695-a7b3-4024-af79-4527b4310e24,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb1a695-a7') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG os_vif [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f3:26,bridge_name='br-int',has_traffic_filtering=True,id=cfb1a695-a7b3-4024-af79-4527b4310e24,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb1a695-a7') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '759602b9-fff4-5199-a614-5fcee9e71ad6', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfb1a695-a7, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfb1a695-a7, col_values=(('qos', UUID('07f406ce-6d7b-406d-85e1-f52d05c0cad0')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfb1a695-a7, col_values=(('external_ids', {'iface-id': 'cfb1a695-a7b3-4024-af79-4527b4310e24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f3:26', 'vm-uuid': 'fcd6d439-3bed-4d51-8ed1-639a7bc8289e'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:44 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:55:45 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:45 user nova-compute[74932]: INFO os_vif [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f3:26,bridge_name='br-int',has_traffic_filtering=True,id=cfb1a695-a7b3-4024-af79-4527b4310e24,network=Network(56bffba7-8cb5-43e2-a092-7fb36da6d43a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb1a695-a7')
Nov 03 16:55:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:55:45 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] No VIF found with MAC fa:16:3e:68:f3:26, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-e6efe13d-dcf7-4e89-94ad-d359ae325d0b req-53feebc4-cd7c-4847-8681-28e0ecde5ec5 service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Received event network-vif-plugged-cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e6efe13d-dcf7-4e89-94ad-d359ae325d0b req-53feebc4-cd7c-4847-8681-28e0ecde5ec5 service nova] Acquiring lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e6efe13d-dcf7-4e89-94ad-d359ae325d0b req-53feebc4-cd7c-4847-8681-28e0ecde5ec5 service nova] Lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-e6efe13d-dcf7-4e89-94ad-d359ae325d0b req-53feebc4-cd7c-4847-8681-28e0ecde5ec5 service nova] Lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:46 user nova-compute[74932]: DEBUG nova.compute.manager [req-e6efe13d-dcf7-4e89-94ad-d359ae325d0b req-53feebc4-cd7c-4847-8681-28e0ecde5ec5 service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] No waiting events found dispatching network-vif-plugged-cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:55:46 user nova-compute[74932]: WARNING nova.compute.manager [req-e6efe13d-dcf7-4e89-94ad-d359ae325d0b req-53feebc4-cd7c-4847-8681-28e0ecde5ec5 service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Received unexpected event network-vif-plugged-cfb1a695-a7b3-4024-af79-4527b4310e24 for instance with vm_state building and task_state spawning.
Nov 03 16:55:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:55:48 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Instance spawned successfully.
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:48 user nova-compute[74932]: INFO nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:55:48 user nova-compute[74932]: INFO nova.compute.manager [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Took 25.61 seconds to build instance.
Nov 03 16:55:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-a3303d7b-50f1-4995-b16b-cdc5a2ad573d tempest-TestVolumeBootPattern-1760430654 tempest-TestVolumeBootPattern-1760430654-project-member] Lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.992s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-17d61e40-2d87-4b35-80a4-5a976e397cd1 req-c2113d9e-e08c-49de-bc0c-7febe9d9ec84 service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Received event network-vif-plugged-cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-17d61e40-2d87-4b35-80a4-5a976e397cd1 req-c2113d9e-e08c-49de-bc0c-7febe9d9ec84 service nova] Acquiring lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-17d61e40-2d87-4b35-80a4-5a976e397cd1 req-c2113d9e-e08c-49de-bc0c-7febe9d9ec84 service nova] Lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-17d61e40-2d87-4b35-80a4-5a976e397cd1 req-c2113d9e-e08c-49de-bc0c-7febe9d9ec84 service nova] Lock "fcd6d439-3bed-4d51-8ed1-639a7bc8289e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:55:48 user nova-compute[74932]: DEBUG nova.compute.manager [req-17d61e40-2d87-4b35-80a4-5a976e397cd1 req-c2113d9e-e08c-49de-bc0c-7febe9d9ec84 service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] No waiting events found dispatching network-vif-plugged-cfb1a695-a7b3-4024-af79-4527b4310e24 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:55:48 user nova-compute[74932]: WARNING nova.compute.manager [req-17d61e40-2d87-4b35-80a4-5a976e397cd1 req-c2113d9e-e08c-49de-bc0c-7febe9d9ec84 service nova] [instance: fcd6d439-3bed-4d51-8ed1-639a7bc8289e] Received unexpected event network-vif-plugged-cfb1a695-a7b3-4024-af79-4527b4310e24 for instance with vm_state active and task_state None.
Nov 03 16:55:49 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:53 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:54 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:55:59 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:02 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Starting heal instance info cache {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Rebuilding the list of instances to heal {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquired lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Forcefully refreshing network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 16:56:03 user nova-compute[74932]: DEBUG nova.objects.instance [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lazy-loading 'info_cache' on Instance uuid 5184a2c9-d049-4737-8088-3bfd33db22a9 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:56:04 user nova-compute[74932]: DEBUG nova.network.neutron [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updating instance_info_cache with network_info: [{"id": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "address": "fa:16:3e:67:8e:74", "network": {"id": "638ae53c-cd08-4d40-be74-720621295baa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1685088595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04d1eeebf4164638b090201dc42f041e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86a01-51", "ovs_interfaceid": "5ed86a01-51fe-4f43-85c4-ef845d090cca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:56:04 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Releasing lock "refresh_cache-5184a2c9-d049-4737-8088-3bfd33db22a9" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:56:04 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] [instance: 5184a2c9-d049-4737-8088-3bfd33db22a9] Updated the network info_cache for instance {{(pid=74932) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 16:56:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:05 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:06 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:08 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:08 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:08 user nova-compute[74932]: DEBUG nova.compute.manager [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74932) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 16:56:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:09 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:10 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:11 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:13 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Auditing locally available compute resources for user (node: user) {{(pid=74932) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:14 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5184a2c9-d049-4737-8088-3bfd33db22a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74932) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 16:56:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:56:15 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.029190063476562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74932) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance 5184a2c9-d049-4737-8088-3bfd33db22a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Instance fcd6d439-3bed-4d51-8ed1-639a7bc8289e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74932) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74932) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG nova.compute.resource_tracker [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Compute_service record updated for user:user {{(pid=74932) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 16:56:15 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:18 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:18 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:18 user nova-compute[74932]: DEBUG oslo_service.periodic_task [None req-7738c125-cf4f-4ea5-b03d-f2512f749bd2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74932) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 16:56:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:20 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:23 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquiring lock "b1df520d-28d5-4518-bda3-03245a10b9e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:23 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "b1df520d-28d5-4518-bda3-03245a10b9e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:56:24 user nova-compute[74932]: INFO nova.compute.claims [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Claim successful on node user
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:56:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.policy [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78d2ef02322f4e989553c1a99728d66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a890309dad24426ca5b6157584ce6917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:56:24 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Creating image(s)
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "/opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "/opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:24 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk 1073741824" returned: 0 in 0.057s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Successfully created port: 67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.190s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Cannot resize image /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Ensure instance console log exists: /opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Successfully updated port: 67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquiring lock "refresh_cache-b1df520d-28d5-4518-bda3-03245a10b9e2" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Acquired lock "refresh_cache-b1df520d-28d5-4518-bda3-03245a10b9e2" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Received event network-changed-67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.compute.manager [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Refreshing instance network info cache due to event network-changed-67439b28-9905-4c44-8f1a-d19f2903e911. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] Acquiring lock "refresh_cache-b1df520d-28d5-4518-bda3-03245a10b9e2" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:56:25 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.neutron [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Updating instance_info_cache with network_info: [{"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Releasing lock "refresh_cache-b1df520d-28d5-4518-bda3-03245a10b9e2" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Instance network_info: |[{"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] Acquired lock "refresh_cache-b1df520d-28d5-4518-bda3-03245a10b9e2" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Refreshing network info cache for port 67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Start _get_guest_xml network_info=[{"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:56:26 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:56:26 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2000458746',display_name='tempest-TestServerVolumeAttachmentScenario-server-2000458746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2000458746',id=44,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpd8Kcx3ahBcjXX/gfKJIFLjZBIr60ayto6aTi7Vn3fRWUENEihgsxYtVvVZ4pSX057lZ8aktLYotKGWisSwwEZQGnBse5DHGS0GVTFO3gi4ARnB3ORFLFAXM4/gXC2vA==',key_name='tempest-keypair-316151141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a890309dad24426ca5b6157584ce6917',ramdisk_id='',reservation_id='r-6thes0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2076184320',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2076184320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78d2ef02322f4e989553c1a99728d66a',uuid=b1df520d-28d5-4518-bda3-03245a10b9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Converting VIF {"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=67439b28-9905-4c44-8f1a-d19f2903e911,network=Network(a16b893f-8792-4df7-a524-50870b39017c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67439b28-99') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.objects.instance [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lazy-loading 'pci_devices' on Instance uuid b1df520d-28d5-4518-bda3-03245a10b9e2 {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:56:26 user nova-compute[74932]:   <uuid>b1df520d-28d5-4518-bda3-03245a10b9e2</uuid>
Nov 03 16:56:26 user nova-compute[74932]:   <name>instance-0000002c</name>
Nov 03 16:56:26 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:56:26 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:56:26 user nova-compute[74932]:   <metadata>
Nov 03 16:56:26 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:56:26 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:56:26 user nova-compute[74932]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2000458746</nova:name>
Nov 03 16:56:26 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:56:26</nova:creationTime>
Nov 03 16:56:26 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:56:26 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:56:26 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:56:26 user nova-compute[74932]:       <nova:owner>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:user uuid="78d2ef02322f4e989553c1a99728d66a">tempest-TestServerVolumeAttachmentScenario-2076184320-project-member</nova:user>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:project uuid="a890309dad24426ca5b6157584ce6917">tempest-TestServerVolumeAttachmentScenario-2076184320</nova:project>
Nov 03 16:56:26 user nova-compute[74932]:       </nova:owner>
Nov 03 16:56:26 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:56:26 user nova-compute[74932]:       <nova:ports>
Nov 03 16:56:26 user nova-compute[74932]:         <nova:port uuid="67439b28-9905-4c44-8f1a-d19f2903e911">
Nov 03 16:56:26 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 16:56:26 user nova-compute[74932]:         </nova:port>
Nov 03 16:56:26 user nova-compute[74932]:       </nova:ports>
Nov 03 16:56:26 user nova-compute[74932]:     </nova:instance>
Nov 03 16:56:26 user nova-compute[74932]:   </metadata>
Nov 03 16:56:26 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:56:26 user nova-compute[74932]:     <system>
Nov 03 16:56:26 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:56:26 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:56:26 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:56:26 user nova-compute[74932]:       <entry name="serial">b1df520d-28d5-4518-bda3-03245a10b9e2</entry>
Nov 03 16:56:26 user nova-compute[74932]:       <entry name="uuid">b1df520d-28d5-4518-bda3-03245a10b9e2</entry>
Nov 03 16:56:26 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:56:26 user nova-compute[74932]:     </system>
Nov 03 16:56:26 user nova-compute[74932]:   </sysinfo>
Nov 03 16:56:26 user nova-compute[74932]:   <os>
Nov 03 16:56:26 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:56:26 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:56:26 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:56:26 user nova-compute[74932]:   </os>
Nov 03 16:56:26 user nova-compute[74932]:   <features>
Nov 03 16:56:26 user nova-compute[74932]:     <acpi/>
Nov 03 16:56:26 user nova-compute[74932]:     <apic/>
Nov 03 16:56:26 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:56:26 user nova-compute[74932]:   </features>
Nov 03 16:56:26 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:56:26 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:56:26 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:56:26 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:56:26 user nova-compute[74932]:   </clock>
Nov 03 16:56:26 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:56:26 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:56:26 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:56:26 user nova-compute[74932]:   </cpu>
Nov 03 16:56:26 user nova-compute[74932]:   <devices>
Nov 03 16:56:26 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:56:26 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:56:26 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/disk"/>
Nov 03 16:56:26 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:56:26 user nova-compute[74932]:     </disk>
Nov 03 16:56:26 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:56:26 user nova-compute[74932]:       <mac address="fa:16:3e:fd:cb:dd"/>
Nov 03 16:56:26 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:56:26 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:56:26 user nova-compute[74932]:       <target dev="tap67439b28-99"/>
Nov 03 16:56:26 user nova-compute[74932]:     </interface>
Nov 03 16:56:26 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:56:26 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/b1df520d-28d5-4518-bda3-03245a10b9e2/console.log" append="off"/>
Nov 03 16:56:26 user nova-compute[74932]:     </serial>
Nov 03 16:56:26 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:56:26 user nova-compute[74932]:     <video>
Nov 03 16:56:26 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:56:26 user nova-compute[74932]:     </video>
Nov 03 16:56:26 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:56:26 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:56:26 user nova-compute[74932]:     </rng>
Nov 03 16:56:26 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:56:26 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:56:26 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:56:26 user nova-compute[74932]:     </memballoon>
Nov 03 16:56:26 user nova-compute[74932]:   </devices>
Nov 03 16:56:26 user nova-compute[74932]: </domain>
Nov 03 16:56:26 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2000458746',display_name='tempest-TestServerVolumeAttachmentScenario-server-2000458746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2000458746',id=44,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpd8Kcx3ahBcjXX/gfKJIFLjZBIr60ayto6aTi7Vn3fRWUENEihgsxYtVvVZ4pSX057lZ8aktLYotKGWisSwwEZQGnBse5DHGS0GVTFO3gi4ARnB3ORFLFAXM4/gXC2vA==',key_name='tempest-keypair-316151141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a890309dad24426ca5b6157584ce6917',ramdisk_id='',reservation_id='r-6thes0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2076184320',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2076184320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78d2ef02322f4e989553c1a99728d66a',uuid=b1df520d-28d5-4518-bda3-03245a10b9e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Converting VIF {"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=67439b28-9905-4c44-8f1a-d19f2903e911,network=Network(a16b893f-8792-4df7-a524-50870b39017c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67439b28-99') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG os_vif [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=67439b28-9905-4c44-8f1a-d19f2903e911,network=Network(a16b893f-8792-4df7-a524-50870b39017c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67439b28-99') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1a7d43b-9f3e-593e-8ce0-8d263f23e383', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67439b28-99, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67439b28-99, col_values=(('qos', UUID('7d601bd1-89ff-4199-be23-2b81673b7ef5')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67439b28-99, col_values=(('external_ids', {'iface-id': '67439b28-9905-4c44-8f1a-d19f2903e911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:cb:dd', 'vm-uuid': 'b1df520d-28d5-4518-bda3-03245a10b9e2'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:26 user nova-compute[74932]: INFO os_vif [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=67439b28-9905-4c44-8f1a-d19f2903e911,network=Network(a16b893f-8792-4df7-a524-50870b39017c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67439b28-99')
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] No VIF found with MAC fa:16:3e:fd:cb:dd, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Updated VIF entry in instance network info cache for port 67439b28-9905-4c44-8f1a-d19f2903e911. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG nova.network.neutron [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Updating instance_info_cache with network_info: [{"id": "67439b28-9905-4c44-8f1a-d19f2903e911", "address": "fa:16:3e:fd:cb:dd", "network": {"id": "a16b893f-8792-4df7-a524-50870b39017c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1544467685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a890309dad24426ca5b6157584ce6917", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67439b28-99", "ovs_interfaceid": "67439b28-9905-4c44-8f1a-d19f2903e911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:56:26 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-f6d4d53f-740c-49db-bb5d-29c814ed9cc9 req-e8e0feae-1d64-4149-9d77-a88b184972e6 service nova] Releasing lock "refresh_cache-b1df520d-28d5-4518-bda3-03245a10b9e2" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-c51f9e2e-d3b8-48a6-9ea3-4d2a6a50236d req-2d8f9ec7-ded5-48fa-a17b-f5772bd382b3 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Received event network-vif-plugged-67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c51f9e2e-d3b8-48a6-9ea3-4d2a6a50236d req-2d8f9ec7-ded5-48fa-a17b-f5772bd382b3 service nova] Acquiring lock "b1df520d-28d5-4518-bda3-03245a10b9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c51f9e2e-d3b8-48a6-9ea3-4d2a6a50236d req-2d8f9ec7-ded5-48fa-a17b-f5772bd382b3 service nova] Lock "b1df520d-28d5-4518-bda3-03245a10b9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-c51f9e2e-d3b8-48a6-9ea3-4d2a6a50236d req-2d8f9ec7-ded5-48fa-a17b-f5772bd382b3 service nova] Lock "b1df520d-28d5-4518-bda3-03245a10b9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:27 user nova-compute[74932]: DEBUG nova.compute.manager [req-c51f9e2e-d3b8-48a6-9ea3-4d2a6a50236d req-2d8f9ec7-ded5-48fa-a17b-f5772bd382b3 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] No waiting events found dispatching network-vif-plugged-67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:56:27 user nova-compute[74932]: WARNING nova.compute.manager [req-c51f9e2e-d3b8-48a6-9ea3-4d2a6a50236d req-2d8f9ec7-ded5-48fa-a17b-f5772bd382b3 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Received unexpected event network-vif-plugged-67439b28-9905-4c44-8f1a-d19f2903e911 for instance with vm_state building and task_state spawning.
Nov 03 16:56:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:28 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:56:29 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Instance spawned successfully.
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.compute.manager [req-39d69f51-6432-4b23-9d4d-c7bafdff475b req-0ec81a8c-7e54-461f-a6b2-bc4f55abbda2 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Received event network-vif-plugged-67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-39d69f51-6432-4b23-9d4d-c7bafdff475b req-0ec81a8c-7e54-461f-a6b2-bc4f55abbda2 service nova] Acquiring lock "b1df520d-28d5-4518-bda3-03245a10b9e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-39d69f51-6432-4b23-9d4d-c7bafdff475b req-0ec81a8c-7e54-461f-a6b2-bc4f55abbda2 service nova] Lock "b1df520d-28d5-4518-bda3-03245a10b9e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-39d69f51-6432-4b23-9d4d-c7bafdff475b req-0ec81a8c-7e54-461f-a6b2-bc4f55abbda2 service nova] Lock "b1df520d-28d5-4518-bda3-03245a10b9e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.compute.manager [req-39d69f51-6432-4b23-9d4d-c7bafdff475b req-0ec81a8c-7e54-461f-a6b2-bc4f55abbda2 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] No waiting events found dispatching network-vif-plugged-67439b28-9905-4c44-8f1a-d19f2903e911 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:56:29 user nova-compute[74932]: WARNING nova.compute.manager [req-39d69f51-6432-4b23-9d4d-c7bafdff475b req-0ec81a8c-7e54-461f-a6b2-bc4f55abbda2 service nova] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Received unexpected event network-vif-plugged-67439b28-9905-4c44-8f1a-d19f2903e911 for instance with vm_state building and task_state spawning.
Nov 03 16:56:29 user nova-compute[74932]: INFO nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquiring lock "72c611fc-eb0d-479d-871b-e6e3facca8fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "72c611fc-eb0d-479d-871b-e6e3facca8fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:29 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Starting instance... {{(pid=74932) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 16:56:30 user nova-compute[74932]: INFO nova.compute.manager [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] [instance: b1df520d-28d5-4518-bda3-03245a10b9e2] Took 5.97 seconds to build instance.
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-f1124ce0-5528-4eeb-9c0f-33436b692ccf tempest-TestServerVolumeAttachmentScenario-2076184320 tempest-TestServerVolumeAttachmentScenario-2076184320-project-member] Lock "b1df520d-28d5-4518-bda3-03245a10b9e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.070s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74932) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 16:56:30 user nova-compute[74932]: INFO nova.compute.claims [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Claim successful on node user
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.compute.provider_tree [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Inventory has not changed in ProviderTree for provider: 22f2cc45-aa29-4bc9-9ee7-6d401d382067 {{(pid=74932) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.scheduler.client.report [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Inventory has not changed for provider 22f2cc45-aa29-4bc9-9ee7-6d401d382067 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74932) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Start building networks asynchronously for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Allocating IP information in the background. {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.network.neutron [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] allocate_for_instance() {{(pid=74932) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 16:56:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Start building block device mappings for instance. {{(pid=74932) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.policy [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd20ca4922b324bda87e128d92b3cebec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab169c5e34745739ce23800ba360f72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74932) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Start spawning the instance on the hypervisor. {{(pid=74932) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Creating instance directory {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 16:56:30 user nova-compute[74932]: INFO nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Creating image(s)
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "/opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "/opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:30 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.286s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquiring lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk 1073741824 {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2,backing_fmt=raw /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk 1073741824" returned: 0 in 0.079s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "3fb0db7f403f0b8840afc4b195e21315f6c9d9a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fb0db7f403f0b8840afc4b195e21315f6c9d9a2 --force-share --output=json" returned: 0 in 0.207s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk. size=1073741824 {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk --force-share --output=json {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG nova.network.neutron [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Successfully created port: 1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.processutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74932) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG nova.virt.disk.api [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Cannot resize image /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk to a smaller size. {{(pid=74932) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Created local disks {{(pid=74932) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Ensure instance console log exists: /opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/console.log {{(pid=74932) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:31 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Successfully updated port: 1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquiring lock "refresh_cache-72c611fc-eb0d-479d-871b-e6e3facca8fc" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Acquired lock "refresh_cache-72c611fc-eb0d-479d-871b-e6e3facca8fc" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Building network info cache for instance {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Received event network-changed-1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.compute.manager [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Refreshing instance network info cache due to event network-changed-1ca8b05c-dbb3-406e-b592-f2971fa7d333. {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] Acquiring lock "refresh_cache-72c611fc-eb0d-479d-871b-e6e3facca8fc" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Instance cache missing network info. {{(pid=74932) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.neutron [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Updating instance_info_cache with network_info: [{"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Releasing lock "refresh_cache-72c611fc-eb0d-479d-871b-e6e3facca8fc" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Instance network_info: |[{"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74932) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] Acquired lock "refresh_cache-72c611fc-eb0d-479d-871b-e6e3facca8fc" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.neutron [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Refreshing network info cache for port 1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Start _get_guest_xml network_info=[{"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '8156ce23-7acb-4ad0-a7c3-910c755cd964'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 16:56:32 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:56:32 user nova-compute[74932]: WARNING nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CPU controller missing on host. {{(pid=74932) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.host [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CPU controller found on host. {{(pid=74932) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74932) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T16:18:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T16:19:04Z,direct_url=<?>,disk_format='qcow2',id=8156ce23-7acb-4ad0-a7c3-910c755cd964,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='963b05cb9b5441c6ac0a6ce413636c77',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T16:19:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Flavor limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Image limits 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Flavor pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Image pref 0:0:0 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Got 1 possible topologies {{(pid=74932) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.hardware [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74932) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1335392143',display_name='tempest-VolumesSnapshotTestJSON-instance-1335392143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1335392143',id=45,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhfe6aPxNOR8VVQw6Wjhvy4QlqLS1/luWoNbLySbVHDqRhQHPuU1gOknwuD0XVFOf2aI/oQV7TTtO40gg7urtS9RC6WK0hiVyheY+WOPe5kE5YX4m2Q9jfxC/iwlW0DpQ==',key_name='tempest-keypair-720090088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ab169c5e34745739ce23800ba360f72',ramdisk_id='',reservation_id='r-2oswlc9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1920096367',owner_user_name='tempest-VolumesSnapshotTestJSON-1920096367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20ca4922b324bda87e128d92b3cebec',uuid=72c611fc-eb0d-479d-871b-e6e3facca8fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74932) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Converting VIF {"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c1:4a,bridge_name='br-int',has_traffic_filtering=True,id=1ca8b05c-dbb3-406e-b592-f2971fa7d333,network=Network(92b936d2-74be-463e-b497-0018285eb89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca8b05c-db') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.objects.instance [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c611fc-eb0d-479d-871b-e6e3facca8fc {{(pid=74932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] End _get_guest_xml xml=<domain type="kvm">
Nov 03 16:56:32 user nova-compute[74932]:   <uuid>72c611fc-eb0d-479d-871b-e6e3facca8fc</uuid>
Nov 03 16:56:32 user nova-compute[74932]:   <name>instance-0000002d</name>
Nov 03 16:56:32 user nova-compute[74932]:   <memory>524288</memory>
Nov 03 16:56:32 user nova-compute[74932]:   <vcpu>1</vcpu>
Nov 03 16:56:32 user nova-compute[74932]:   <metadata>
Nov 03 16:56:32 user nova-compute[74932]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 16:56:32 user nova-compute[74932]:       <nova:package version="0.0.0"/>
Nov 03 16:56:32 user nova-compute[74932]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1335392143</nova:name>
Nov 03 16:56:32 user nova-compute[74932]:       <nova:creationTime>2023-11-03 16:56:32</nova:creationTime>
Nov 03 16:56:32 user nova-compute[74932]:       <nova:flavor name="m1.tiny">
Nov 03 16:56:32 user nova-compute[74932]:         <nova:memory>512</nova:memory>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:disk>1</nova:disk>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:swap>0</nova:swap>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:vcpus>1</nova:vcpus>
Nov 03 16:56:32 user nova-compute[74932]:       </nova:flavor>
Nov 03 16:56:32 user nova-compute[74932]:       <nova:owner>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:user uuid="d20ca4922b324bda87e128d92b3cebec">tempest-VolumesSnapshotTestJSON-1920096367-project-member</nova:user>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:project uuid="4ab169c5e34745739ce23800ba360f72">tempest-VolumesSnapshotTestJSON-1920096367</nova:project>
Nov 03 16:56:32 user nova-compute[74932]:       </nova:owner>
Nov 03 16:56:32 user nova-compute[74932]:       <nova:root type="image" uuid="8156ce23-7acb-4ad0-a7c3-910c755cd964"/>
Nov 03 16:56:32 user nova-compute[74932]:       <nova:ports>
Nov 03 16:56:32 user nova-compute[74932]:         <nova:port uuid="1ca8b05c-dbb3-406e-b592-f2971fa7d333">
Nov 03 16:56:32 user nova-compute[74932]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 16:56:32 user nova-compute[74932]:         </nova:port>
Nov 03 16:56:32 user nova-compute[74932]:       </nova:ports>
Nov 03 16:56:32 user nova-compute[74932]:     </nova:instance>
Nov 03 16:56:32 user nova-compute[74932]:   </metadata>
Nov 03 16:56:32 user nova-compute[74932]:   <sysinfo type="smbios">
Nov 03 16:56:32 user nova-compute[74932]:     <system>
Nov 03 16:56:32 user nova-compute[74932]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 16:56:32 user nova-compute[74932]:       <entry name="product">OpenStack Nova</entry>
Nov 03 16:56:32 user nova-compute[74932]:       <entry name="version">0.0.0</entry>
Nov 03 16:56:32 user nova-compute[74932]:       <entry name="serial">72c611fc-eb0d-479d-871b-e6e3facca8fc</entry>
Nov 03 16:56:32 user nova-compute[74932]:       <entry name="uuid">72c611fc-eb0d-479d-871b-e6e3facca8fc</entry>
Nov 03 16:56:32 user nova-compute[74932]:       <entry name="family">Virtual Machine</entry>
Nov 03 16:56:32 user nova-compute[74932]:     </system>
Nov 03 16:56:32 user nova-compute[74932]:   </sysinfo>
Nov 03 16:56:32 user nova-compute[74932]:   <os>
Nov 03 16:56:32 user nova-compute[74932]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 16:56:32 user nova-compute[74932]:     <boot dev="hd"/>
Nov 03 16:56:32 user nova-compute[74932]:     <smbios mode="sysinfo"/>
Nov 03 16:56:32 user nova-compute[74932]:   </os>
Nov 03 16:56:32 user nova-compute[74932]:   <features>
Nov 03 16:56:32 user nova-compute[74932]:     <acpi/>
Nov 03 16:56:32 user nova-compute[74932]:     <apic/>
Nov 03 16:56:32 user nova-compute[74932]:     <vmcoreinfo/>
Nov 03 16:56:32 user nova-compute[74932]:   </features>
Nov 03 16:56:32 user nova-compute[74932]:   <clock offset="utc">
Nov 03 16:56:32 user nova-compute[74932]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 16:56:32 user nova-compute[74932]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 16:56:32 user nova-compute[74932]:     <timer name="hpet" present="no"/>
Nov 03 16:56:32 user nova-compute[74932]:   </clock>
Nov 03 16:56:32 user nova-compute[74932]:   <cpu mode="custom" match="exact">
Nov 03 16:56:32 user nova-compute[74932]:     <model>Nehalem</model>
Nov 03 16:56:32 user nova-compute[74932]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 16:56:32 user nova-compute[74932]:   </cpu>
Nov 03 16:56:32 user nova-compute[74932]:   <devices>
Nov 03 16:56:32 user nova-compute[74932]:     <disk type="file" device="disk">
Nov 03 16:56:32 user nova-compute[74932]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 16:56:32 user nova-compute[74932]:       <source file="/opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/disk"/>
Nov 03 16:56:32 user nova-compute[74932]:       <target dev="vda" bus="virtio"/>
Nov 03 16:56:32 user nova-compute[74932]:     </disk>
Nov 03 16:56:32 user nova-compute[74932]:     <interface type="ethernet">
Nov 03 16:56:32 user nova-compute[74932]:       <mac address="fa:16:3e:90:c1:4a"/>
Nov 03 16:56:32 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:56:32 user nova-compute[74932]:       <mtu size="1442"/>
Nov 03 16:56:32 user nova-compute[74932]:       <target dev="tap1ca8b05c-db"/>
Nov 03 16:56:32 user nova-compute[74932]:     </interface>
Nov 03 16:56:32 user nova-compute[74932]:     <serial type="pty">
Nov 03 16:56:32 user nova-compute[74932]:       <log file="/opt/stack/data/nova/instances/72c611fc-eb0d-479d-871b-e6e3facca8fc/console.log" append="off"/>
Nov 03 16:56:32 user nova-compute[74932]:     </serial>
Nov 03 16:56:32 user nova-compute[74932]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 16:56:32 user nova-compute[74932]:     <video>
Nov 03 16:56:32 user nova-compute[74932]:       <model type="virtio"/>
Nov 03 16:56:32 user nova-compute[74932]:     </video>
Nov 03 16:56:32 user nova-compute[74932]:     <rng model="virtio">
Nov 03 16:56:32 user nova-compute[74932]:       <backend model="random">/dev/urandom</backend>
Nov 03 16:56:32 user nova-compute[74932]:     </rng>
Nov 03 16:56:32 user nova-compute[74932]:     <controller type="usb" index="0" model="none"/>
Nov 03 16:56:32 user nova-compute[74932]:     <memballoon model="virtio">
Nov 03 16:56:32 user nova-compute[74932]:       <stats period="10"/>
Nov 03 16:56:32 user nova-compute[74932]:     </memballoon>
Nov 03 16:56:32 user nova-compute[74932]:   </devices>
Nov 03 16:56:32 user nova-compute[74932]: </domain>
Nov 03 16:56:32 user nova-compute[74932]:  {{(pid=74932) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.vif [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T16:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1335392143',display_name='tempest-VolumesSnapshotTestJSON-instance-1335392143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1335392143',id=45,image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhfe6aPxNOR8VVQw6Wjhvy4QlqLS1/luWoNbLySbVHDqRhQHPuU1gOknwuD0XVFOf2aI/oQV7TTtO40gg7urtS9RC6WK0hiVyheY+WOPe5kE5YX4m2Q9jfxC/iwlW0DpQ==',key_name='tempest-keypair-720090088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ab169c5e34745739ce23800ba360f72',ramdisk_id='',reservation_id='r-2oswlc9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8156ce23-7acb-4ad0-a7c3-910c755cd964',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1920096367',owner_user_name='tempest-VolumesSnapshotTestJSON-1920096367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T16:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20ca4922b324bda87e128d92b3cebec',uuid=72c611fc-eb0d-479d-871b-e6e3facca8fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Converting VIF {"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.network.os_vif_util [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c1:4a,bridge_name='br-int',has_traffic_filtering=True,id=1ca8b05c-dbb3-406e-b592-f2971fa7d333,network=Network(92b936d2-74be-463e-b497-0018285eb89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca8b05c-db') {{(pid=74932) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG os_vif [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c1:4a,bridge_name='br-int',has_traffic_filtering=True,id=1ca8b05c-dbb3-406e-b592-f2971fa7d333,network=Network(92b936d2-74be-463e-b497-0018285eb89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca8b05c-db') {{(pid=74932) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef5f9e7b-fd8c-5716-94ea-b862e8d59b6a', '_type': 'linux-noop'}}, row=False) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ca8b05c-db, may_exist=True, interface_attrs={}) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ca8b05c-db, col_values=(('qos', UUID('224069be-5162-430c-9029-284ce8829143')),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ca8b05c-db, col_values=(('external_ids', {'iface-id': '1ca8b05c-dbb3-406e-b592-f2971fa7d333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:c1:4a', 'vm-uuid': '72c611fc-eb0d-479d-871b-e6e3facca8fc'}),), if_exists=True) {{(pid=74932) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:32 user nova-compute[74932]: INFO os_vif [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c1:4a,bridge_name='br-int',has_traffic_filtering=True,id=1ca8b05c-dbb3-406e-b592-f2971fa7d333,network=Network(92b936d2-74be-463e-b497-0018285eb89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca8b05c-db')
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] No BDM found with device name vda, not building metadata. {{(pid=74932) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 16:56:32 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] No VIF found with MAC fa:16:3e:90:c1:4a, not building metadata {{(pid=74932) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 16:56:33 user nova-compute[74932]: DEBUG nova.network.neutron [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Updated VIF entry in instance network info cache for port 1ca8b05c-dbb3-406e-b592-f2971fa7d333. {{(pid=74932) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 16:56:33 user nova-compute[74932]: DEBUG nova.network.neutron [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Updating instance_info_cache with network_info: [{"id": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "address": "fa:16:3e:90:c1:4a", "network": {"id": "92b936d2-74be-463e-b497-0018285eb89a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1127603892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ab169c5e34745739ce23800ba360f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca8b05c-db", "ovs_interfaceid": "1ca8b05c-dbb3-406e-b592-f2971fa7d333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74932) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 16:56:33 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-cebaea78-f023-4ebc-a419-1b740326b442 req-983f5e19-d588-44cf-93c1-d6eb101ee028 service nova] Releasing lock "refresh_cache-72c611fc-eb0d-479d-871b-e6e3facca8fc" {{(pid=74932) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 16:56:33 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-66bc7f54-6211-4166-95f1-cbd41a35b77a req-5ce43bbf-1ef6-4e38-96b3-965d654669e1 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Received event network-vif-plugged-1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-66bc7f54-6211-4166-95f1-cbd41a35b77a req-5ce43bbf-1ef6-4e38-96b3-965d654669e1 service nova] Acquiring lock "72c611fc-eb0d-479d-871b-e6e3facca8fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-66bc7f54-6211-4166-95f1-cbd41a35b77a req-5ce43bbf-1ef6-4e38-96b3-965d654669e1 service nova] Lock "72c611fc-eb0d-479d-871b-e6e3facca8fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-66bc7f54-6211-4166-95f1-cbd41a35b77a req-5ce43bbf-1ef6-4e38-96b3-965d654669e1 service nova] Lock "72c611fc-eb0d-479d-871b-e6e3facca8fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:34 user nova-compute[74932]: DEBUG nova.compute.manager [req-66bc7f54-6211-4166-95f1-cbd41a35b77a req-5ce43bbf-1ef6-4e38-96b3-965d654669e1 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] No waiting events found dispatching network-vif-plugged-1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:56:34 user nova-compute[74932]: WARNING nova.compute.manager [req-66bc7f54-6211-4166-95f1-cbd41a35b77a req-5ce43bbf-1ef6-4e38-96b3-965d654669e1 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Received unexpected event network-vif-plugged-1ca8b05c-dbb3-406e-b592-f2971fa7d333 for instance with vm_state building and task_state spawning.
Nov 03 16:56:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:35 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Instance event wait completed in 0 seconds for  {{(pid=74932) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Guest created on hypervisor {{(pid=74932) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 16:56:36 user nova-compute[74932]: INFO nova.virt.libvirt.driver [-] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Instance spawned successfully.
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Found default for hw_cdrom_bus of ide {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Found default for hw_disk_bus of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Found default for hw_input_bus of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Found default for hw_pointer_model of None {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Found default for hw_video_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.virt.libvirt.driver [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Found default for hw_vif_model of virtio {{(pid=74932) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-ea61a904-80b4-4893-9aeb-220585c1eabf req-e943d8c2-6fff-47b3-b70c-f76604262617 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Received event network-vif-plugged-1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ea61a904-80b4-4893-9aeb-220585c1eabf req-e943d8c2-6fff-47b3-b70c-f76604262617 service nova] Acquiring lock "72c611fc-eb0d-479d-871b-e6e3facca8fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ea61a904-80b4-4893-9aeb-220585c1eabf req-e943d8c2-6fff-47b3-b70c-f76604262617 service nova] Lock "72c611fc-eb0d-479d-871b-e6e3facca8fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [req-ea61a904-80b4-4893-9aeb-220585c1eabf req-e943d8c2-6fff-47b3-b70c-f76604262617 service nova] Lock "72c611fc-eb0d-479d-871b-e6e3facca8fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.compute.manager [req-ea61a904-80b4-4893-9aeb-220585c1eabf req-e943d8c2-6fff-47b3-b70c-f76604262617 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] No waiting events found dispatching network-vif-plugged-1ca8b05c-dbb3-406e-b592-f2971fa7d333 {{(pid=74932) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 16:56:36 user nova-compute[74932]: WARNING nova.compute.manager [req-ea61a904-80b4-4893-9aeb-220585c1eabf req-e943d8c2-6fff-47b3-b70c-f76604262617 service nova] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Received unexpected event network-vif-plugged-1ca8b05c-dbb3-406e-b592-f2971fa7d333 for instance with vm_state building and task_state spawning.
Nov 03 16:56:36 user nova-compute[74932]: INFO nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 03 16:56:36 user nova-compute[74932]: DEBUG nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Checking state {{(pid=74932) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 16:56:36 user nova-compute[74932]: INFO nova.compute.manager [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] [instance: 72c611fc-eb0d-479d-871b-e6e3facca8fc] Took 6.86 seconds to build instance.
Nov 03 16:56:36 user nova-compute[74932]: DEBUG oslo_concurrency.lockutils [None req-69be6155-3142-492f-9ccf-8092f70fc39b tempest-VolumesSnapshotTestJSON-1920096367 tempest-VolumesSnapshotTestJSON-1920096367-project-member] Lock "72c611fc-eb0d-479d-871b-e6e3facca8fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.986s {{(pid=74932) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 16:56:37 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:38 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:42 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:43 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 16:56:47 user nova-compute[74932]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74932) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}